-- Logs begin at Tue 2022-08-30 00:08:57 UTC, end at Tue 2022-08-30 01:15:25 UTC. -- Aug 30 00:47:03.431645 dv-cinder-815746-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 00:47:03.443822 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 00:47:03 2022] *** Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: nodename: dv-cinder-815746-8-iscsi Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: machine: x86_64 Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: clock source: unix Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: pcre jit disabled Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: detected number of CPU cores: 4 Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: current working directory: / Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: detected binary path: /usr/bin/uwsgi-core Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: your processes number limit is 47680 Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: your memory page size is 4096 bytes Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: detected max file descriptor number: 2048 Aug 30 00:47:03.446618 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: lock engine: pthread robust mutexes Aug 30 00:47:03.448250 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: thunder lock: enabled Aug 30 00:47:03.448250 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 00:47:03.448250 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 00:47:03.486935 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: Python main interpreter initialized at 0x5647a83389c0 Aug 30 00:47:03.486935 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: python threads support enabled Aug 30 00:47:03.486935 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: your server socket listen backlog is limited to 100 connections Aug 30 00:47:03.486935 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: your mercy for graceful operations on workers is 90 seconds Aug 30 00:47:03.487355 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 00:47:03.487355 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: *** Operational MODE: preforking *** Aug 30 00:47:03.487628 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: *** uWSGI is running in multiple interpreter mode *** Aug 30 00:47:03.487628 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: spawned uWSGI master process (pid: 129802) Aug 30 00:47:03.487827 dv-cinder-815746-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 00:47:03.488418 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: spawned uWSGI worker 1 (pid: 129803, cores: 1) Aug 30 00:47:03.489225 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: spawned uWSGI worker 2 (pid: 129804, cores: 1) Aug 30 00:47:03.489225 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 00:47:04.142021 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 00:47:04.207088 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 00:47:05.224161 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:47:05.224161 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: from cryptography.utils import int_from_bytes Aug 30 00:47:05.224790 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:47:05.224790 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: from cryptography.utils import int_from_bytes Aug 30 00:47:05.291290 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:47:05.291290 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: from cryptography.utils import int_from_bytes Aug 30 00:47:05.292176 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:47:05.292176 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: from cryptography.utils import int_from_bytes Aug 30 00:47:07.684336 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:47:07.684997 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:47:07.684997 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:47:07.685291 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:47:07.685707 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:47:07.685820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:47:07.685892 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:47:07.685974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.686041 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:47:07.686242 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.686426 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:47:07.686592 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.686687 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:47:07.686878 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.687056 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.687236 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.687378 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.687544 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.687682 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.687861 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.688011 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.688144 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.688285 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.688487 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.688631 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.688730 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.688904 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.688996 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.689221 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.689312 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815746-8-iscsi {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.689561 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.689659 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.689816 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.689902 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.690118 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.690219 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.690439 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815746-8-iscsi {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.690541 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.690760 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.690850 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.691085 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.691194 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.691396 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.691485 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.691711 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.691878 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.691990 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693106 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693252 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693361 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693458 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693539 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693617 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693767 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693852 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.693992 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694074 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694151 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694290 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694381 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694461 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694547 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694671 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694762 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.694905 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.695054 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.695240 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.695329 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815746-8-iscsi {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.695548 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.695656 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.695865 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.695957 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.696171 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.696274 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.696551 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815746-8-iscsi {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.696681 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.696878 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.696991 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.697171 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.697286 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.697482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.697590 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.698139 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.698330 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.698463 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.698559 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.698631 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.698713 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.698864 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.698959 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.699200 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.699310 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.699508 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.699618 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.699822 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.699918 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.700103 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.700201 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.700402 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.700504 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.700709 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.700805 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.701006 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.701107 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.701304 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.701399 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.701544 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.701639 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.701848 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.701932 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.702167 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.702288 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.702489 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.702602 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.702737 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.702831 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.703046 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.703138 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.703318 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.703408 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.703632 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.703729 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.703945 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.704040 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.704236 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.704330 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.704485 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.704574 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.704802 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.704889 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.705097 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.705214 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.705395 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.705490 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.705691 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.705779 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.705986 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.706074 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.706284 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.706378 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.706585 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.706723 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.706887 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.706988 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.707215 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.707305 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.707521 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.707615 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.707829 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.707924 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.708145 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.708231 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.708448 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.708533 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.708751 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.708853 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.709068 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.709155 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.709378 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.709470 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.709679 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.710193 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.710348 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.710436 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.710657 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.710745 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.710955 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.711086 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.711285 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.711385 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.711583 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.711672 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.711900 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.711988 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.712204 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.712354 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.712505 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.712599 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.712748 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.712836 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.713040 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.713143 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.713416 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.713568 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.713777 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.714200 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.714309 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.714441 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.714536 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.714627 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.714718 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.714799 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.714968 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.715091 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.715298 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.715395 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.715595 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.715691 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.715894 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.715993 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.716191 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.716293 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.716487 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.716575 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.716785 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.716880 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.717084 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.717180 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.717382 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.717474 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.717679 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.717807 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.717978 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.718154 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.718289 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.718384 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.718586 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.718672 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.718887 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.718986 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.719219 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.719317 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.719526 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.719613 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.719825 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.719924 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.720122 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.720209 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.720421 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.720519 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.720723 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.720818 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.721020 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.721113 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.721318 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.721405 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.721616 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.721714 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.721913 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.721998 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.722208 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.722294 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.722510 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.722597 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.722804 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.722890 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.723126 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.723217 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.723432 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.723519 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.723728 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.723813 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.724026 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.724116 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.724324 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.724415 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.724617 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.724703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.724913 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.725000 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.725208 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.725313 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.725502 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.725592 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.725795 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.725881 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.726085 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.726173 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.726384 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.726469 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.726684 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.726784 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.726984 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.727141 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.727300 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.727394 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.727595 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.727690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.727906 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.727994 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.728214 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.728299 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.728516 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.728610 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.728819 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.728948 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.729212 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:47:07.729621 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.729757 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.729854 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.729937 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.730015 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.730143 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.730301 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.730455 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.730610 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.730786 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.730913 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.731141 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.731261 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.731463 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.731559 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.731775 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.731863 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.732085 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.732181 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.732407 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.732501 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.732715 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.732810 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.733024 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.733120 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.733333 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.733445 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.733639 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.733733 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.733948 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.734036 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.734248 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.734337 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.734558 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.734646 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.734866 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.734960 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.735207 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.735304 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.735510 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.735596 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.735822 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.735955 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.736146 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.736239 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.736467 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.736554 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.736767 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.736861 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.737076 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.737165 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.737381 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.737470 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.737687 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.737783 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.737992 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.738085 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.738310 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.738397 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.738638 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.738728 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.738943 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.739082 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.739277 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.739366 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.739579 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.739666 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.739893 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.739979 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.740196 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.740283 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.740538 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.740646 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.740800 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.740889 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.741102 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.741189 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.741403 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.741491 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.741710 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.741799 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.742018 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.742114 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.742324 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.742411 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.742630 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.742717 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.742932 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.743061 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.743266 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.743363 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.743570 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.743657 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.743870 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.743965 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.744170 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.744258 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.744476 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.744657 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.744926 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.745090 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.745219 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.745300 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.745515 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.745612 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.745815 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.745912 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.746122 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.746216 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.746427 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.746513 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.746730 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.746816 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.747059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.747163 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.747378 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.747471 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.747682 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.747778 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.747986 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.748073 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.748288 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.748375 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.748588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.748675 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.748897 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.748983 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.749198 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.749291 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.749495 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.749594 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.749798 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.749882 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.750098 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.750192 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.750394 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.750480 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.750698 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.750802 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.750992 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.751105 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.751312 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.751399 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.751624 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.751780 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.751925 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.752072 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.752209 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.752344 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.752528 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.752659 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.752835 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.752979 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.753147 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.753292 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.753449 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.753585 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.753741 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.753884 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.754054 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.754189 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.754373 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.754514 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.754672 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.754803 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.754978 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.755131 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.755318 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.755407 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.755627 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.755723 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.755924 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.756011 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.756226 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.756319 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.756524 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.756612 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.756817 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.756906 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.757115 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.757238 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.757418 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.757509 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.757714 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.757802 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.758010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.760293 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.760461 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.760616 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.760751 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.760885 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.761135 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.761261 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.761261 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.761490 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.761578 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.761704 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.761704 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.761943 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762029 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762152 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762152 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762345 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762441 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762523 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762646 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762646 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762854 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.762945 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.763168 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.763375 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.763375 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.763720 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.763805 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.763805 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764046 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764130 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764254 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764338 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764475 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764570 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764570 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764772 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764856 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.764856 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.765054 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.765144 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.765229 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.765350 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.765532 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.765631 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.765839 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.766057 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.766152 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.766450 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.766543 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.766777 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.766876 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.767112 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.767373 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.767514 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.767723 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.767809 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.768034 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.768237 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.768378 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.768650 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.768743 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.769011 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.769099 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.769331 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.769465 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.769640 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.769893 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.769980 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.770242 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.770331 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.770551 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.770763 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.770851 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.771179 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.771291 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.771493 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.771700 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.771787 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.772103 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.772191 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.772413 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.772562 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.772732 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.772988 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.773079 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.773341 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.773438 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.773642 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.773822 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.773955 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.774241 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.774343 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.774601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.774694 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.774907 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.775147 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.775239 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.775547 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.775636 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.776013 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.776587 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.776677 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.776808 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.776916 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.776999 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.777122 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.777263 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.777362 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.777646 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.777744 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.777961 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.778160 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.778278 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.778593 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.778688 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.778899 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.779090 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.779239 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.779516 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.779603 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.779838 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.779927 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.780139 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.780352 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.780440 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.780746 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.780844 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.781053 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.781268 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.781369 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.781626 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.781717 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.781970 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.782088 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.782276 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.782488 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.782598 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.782909 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.783040 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.783237 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.783381 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.783540 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.783807 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.783903 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.784167 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.784253 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.784472 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.784633 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.784775 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.785088 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.785252 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.785410 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.785599 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.785757 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.786012 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.786187 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.786353 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.786557 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.786728 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.786922 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.787105 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.787278 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.787549 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.787725 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.787876 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.788125 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.788292 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.788422 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.788573 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.788732 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.788983 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.789125 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.789346 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.789475 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.789654 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.789794 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.789961 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.790163 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.790305 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.790556 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.790684 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.790874 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.791022 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.791451 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.792057 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.792158 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.792230 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.792306 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.792440 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.792639 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.792728 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.792967 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.793065 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.793314 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.793458 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.793645 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.793884 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.793973 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.794274 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.794361 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.794580 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.794678 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.794892 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.795143 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.795237 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.795513 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.795601 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.795822 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.795978 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.796138 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.796442 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.796602 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.796768 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.796956 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.797129 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.797326 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.797480 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.797630 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.797915 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.798093 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.798263 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.798610 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.798772 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.798938 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.799221 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.799492 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.799492 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.799761 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.799908 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.800053 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.800196 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.800361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.800581 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.800735 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.800880 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.801098 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.801264 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.801551 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.801717 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.801874 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.802160 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.802451 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.802593 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.802721 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.802847 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.803137 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.803401 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.803622 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.803791 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.803993 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.804174 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.804328 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.804591 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.804740 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.804955 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.805182 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.805371 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.805512 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.805726 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.805892 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.806052 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.806278 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.806446 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.806648 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.806841 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.807456 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.807456 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.807733 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.807880 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.808024 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.808165 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.808311 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.808542 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.808710 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.808856 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.809035 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.809167 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.809460 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.809558 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.809771 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.809860 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.810076 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.810284 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.810392 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.810696 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.810787 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.811014 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.811189 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.811325 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.811617 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.811775 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.811930 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.812106 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.812235 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.812520 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.812615 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.812850 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.812940 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.813155 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.813337 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.813456 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.813758 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.813847 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.814059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.814197 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.814360 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.814613 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.814709 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.814972 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.815096 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.815307 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.815508 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.815604 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.815903 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.815989 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.816204 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.816406 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.816493 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.816791 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.816889 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.817096 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.817222 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.817396 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.817643 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.817830 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.817986 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.818216 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.818390 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.818542 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.818742 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.818910 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.819178 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.819270 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.819480 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.819668 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.819768 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.820069 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.820157 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.820407 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.820497 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.820711 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.820915 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.821067 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.821362 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.821460 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.821683 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.821928 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.822106 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.822292 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.822460 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.822622 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.822841 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.822998 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.823247 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.823391 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.823549 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.823843 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.823997 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.824146 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.824367 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.824520 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.824724 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.824873 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.825046 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.825338 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.825511 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.825659 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.825871 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.826037 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.826284 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.826510 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.826661 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.826868 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.827056 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.827205 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.827430 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.827603 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.827799 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.827945 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.828102 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.828404 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.828555 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.828749 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.828924 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.829070 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.829309 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.829459 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.829605 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.829902 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.830054 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.830200 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.830423 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.830577 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.830826 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.830969 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.831172 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.831473 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.831629 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.831773 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.832005 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.832160 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.832364 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.832512 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.832655 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.832969 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.833135 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.833282 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.833485 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.833691 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.833961 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.834130 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.834292 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.834480 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.834631 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.835239 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.835399 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.835557 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.835828 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.835981 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.836126 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.836343 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.836551 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.836837 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.836999 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.837147 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.837373 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.837526 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.837734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.837894 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.838048 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.838396 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.838556 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.838701 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.838925 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.839135 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.839349 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.839496 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.839639 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.839921 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.840086 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.840244 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.840452 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.840605 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.840843 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.841001 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.841256 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.841465 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.841610 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.841858 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.842005 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.842272 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.842439 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.842583 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.842874 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.843052 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.843208 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.843430 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.843602 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.843839 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.844000 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.844144 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.844407 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.844572 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.844716 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.844923 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.845074 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.845347 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.845495 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.845651 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.845887 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.846040 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.846237 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.846384 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.846557 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.846859 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.847050 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.847195 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.847430 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.847583 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.847897 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.848066 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.848211 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.848415 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.848569 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.848826 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.848996 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.849142 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.849382 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.849535 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.849723 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.849947 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.850114 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.850323 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.850469 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.850607 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.850935 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.851171 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.851330 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.851540 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.851687 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.851844 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.852046 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.852247 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.852407 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.852591 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.852755 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.853016 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.853166 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.853330 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.853576 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.853727 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.854124 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.854336 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.854490 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.854636 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.854832 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.854985 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.855241 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.855407 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.855553 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.855838 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.855988 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.856133 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.856364 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.856515 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.856747 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.856892 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.857048 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.857317 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.857456 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.857682 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.857844 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.858005 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.858287 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.858425 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.858632 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.858776 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.858971 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.859297 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.859445 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.859617 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.859841 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.859991 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.860307 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.860458 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.860604 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.860823 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.860955 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.861123 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.861471 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.861687 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.861687 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.861978 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.862123 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.862297 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.862441 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.862587 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.862889 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.863089 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.863235 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.863462 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.863629 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.863831 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.863978 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.864131 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.864429 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.864580 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.864724 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.864960 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.865114 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.865343 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.865491 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.865639 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.865942 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.866111 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.866257 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.866459 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.866614 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.866929 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.867123 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.867288 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.867482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.867635 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.867870 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.868027 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.868183 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.868467 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.868633 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.868778 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.868992 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.869144 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.869374 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.869581 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.869883 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.870217 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.870353 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.870660 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.870824 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.871159 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.871333 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.871499 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.871724 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.871877 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.872072 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.872369 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.872523 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.872666 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.872887 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.873053 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.873277 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.873435 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.873585 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.873861 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.874027 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.874184 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.874386 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.874540 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.874812 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.874961 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.875185 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.875406 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.875559 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.875776 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.875935 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.876080 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.876378 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.876532 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.876731 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.877023 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.877177 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.877322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.877544 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.877695 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.877928 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.878077 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.878224 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.878514 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.878679 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.878822 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.879046 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.879202 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.879462 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.879680 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.879840 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.880048 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.880203 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.880347 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.880600 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.880769 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.880964 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.881110 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.881295 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.881580 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.881733 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.881889 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.882095 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.882249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.882508 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.882675 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.883037 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.883211 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.883356 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.883608 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.883761 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.883981 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.884262 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.884428 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.884585 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.884790 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.884944 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.885279 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.885494 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.885735 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.886000 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.886154 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.886300 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.886516 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.886683 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.886828 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.887072 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.887226 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.887463 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.887637 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.887782 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.888072 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.888221 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.888377 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.888611 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.888905 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.889129 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.889279 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.889559 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.889721 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.889865 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.890109 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.890260 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.890498 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.890657 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.890814 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.891141 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.891312 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.891457 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.891669 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.891820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.892033 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.892192 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.892338 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.892632 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.892781 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.892923 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.893188 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.893357 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.893528 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.893733 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.893889 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.894129 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.894275 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.894444 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.894724 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.894878 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.895112 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.895403 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.895557 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.895735 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.895944 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.896096 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.896298 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.896457 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.896616 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.896891 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.897040 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.897183 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.897444 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.897596 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.897858 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.898000 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.898145 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.898354 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.898499 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.898656 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.898939 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.899121 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.899249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.899473 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.899604 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.899918 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.900074 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.900204 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.900438 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.900576 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.901335 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.901671 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.901805 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.901805 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.902099 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.902235 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.902235 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.902493 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.902630 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.902757 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.902893 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.903167 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.903310 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.903657 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.903793 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.903921 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.904229 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.904386 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.904560 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.904756 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.904912 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.905161 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.905292 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.905482 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.905792 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.905944 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.906088 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.906331 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.906485 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.906697 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.906862 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.907038 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.907325 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.907480 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.907633 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.907885 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.908059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.908205 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.908413 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.908565 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.908809 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.908957 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.909114 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.909384 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.909538 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.909689 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.909897 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.910069 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.910288 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.910472 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.910640 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.910937 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.911176 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.911393 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.911539 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.911682 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.911909 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.912057 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.912211 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.912513 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.912664 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.912819 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.913053 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.913262 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.913475 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.913618 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.913761 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.914025 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.914174 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.914317 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.914614 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.914767 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.915052 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.915202 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.915348 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.915629 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.915800 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.915962 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.916149 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.916300 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.916732 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.916902 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.917149 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.917289 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.917474 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.917709 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.917803 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.918109 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.918206 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.918447 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.918537 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.918778 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.918952 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.919126 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.919402 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.919490 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.919725 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.919811 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.920031 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.920219 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.920346 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.920666 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.920840 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.920993 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.921184 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.921342 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.921547 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.921711 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.921861 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.922147 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.922315 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.922469 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.922691 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.922845 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.923060 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.923241 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.923479 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.923629 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.923780 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.923927 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.924222 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.924376 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.924537 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.924766 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.924918 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.925167 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.925319 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.925477 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.925697 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.925854 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.926001 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.926283 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.926447 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.926606 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.926852 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.927040 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.927203 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.927438 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.927612 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.927837 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.927999 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.928152 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.928454 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.928611 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.928765 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.928991 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.929159 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.929385 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.929532 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.929706 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.929999 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.930152 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.930297 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.930521 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.930675 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.930934 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.931171 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.931319 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.931561 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.931710 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.931854 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.932154 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.932330 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.932644 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.932938 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.933092 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.933382 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.933637 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.933797 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.933941 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.934085 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.934305 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.934520 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.934692 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.934929 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.935106 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.935253 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.935488 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.935658 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.935887 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.936032 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.936176 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.936473 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.936625 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.936771 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.936997 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.937149 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.937395 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.937544 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.937690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.937976 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.938132 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.938308 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.938527 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.938682 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.938945 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.939153 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.939303 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.939573 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.939727 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.939906 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.940130 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.940305 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.940566 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.940715 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.940864 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.941118 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.941284 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.941518 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.941664 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.941807 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.942093 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.942246 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.942406 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.942647 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129803) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:47:07.942796 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.943149 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.943556 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.943971 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.944378 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.944781 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.945182 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.945580 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.945990 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.946398 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.946799 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.947233 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.947670 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.948093 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.948504 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.948944 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.949353 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.949756 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.950156 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.950561 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.951208 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.951608 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.952024 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.952435 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.952857 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.953263 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.953681 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.954112 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.954505 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.954897 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.955337 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.955737 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.956140 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.956549 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.956953 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.957344 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.957753 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.958150 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.958779 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.959264 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.960049 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.960472 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.960896 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.961306 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.961701 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.962109 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.962504 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.962895 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.963504 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.963980 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.964366 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.964762 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.965171 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.965570 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.965963 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.966371 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.966819 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.967269 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.967665 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.968057 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.968451 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.968877 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.969267 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.969662 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.970054 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.970459 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.970863 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.971289 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.971684 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.972078 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.972476 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.972870 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.973281 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.973712 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.974181 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.974575 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.974971 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.975406 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.975818 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.976227 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.976632 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.977078 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.977510 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.977915 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.978545 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.979256 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.979597 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.980020 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.980446 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.980851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.981247 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.981646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.982056 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.982454 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.982858 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.983288 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.983689 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.984093 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.984576 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.984977 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.985386 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.985794 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.986195 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.986594 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.987087 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.987474 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.987885 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.988292 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.988735 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.989144 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.989548 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.989961 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.990372 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.990769 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.991208 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.991609 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.992004 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.992432 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.992867 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.993267 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.993658 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.994181 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.994691 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.995144 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.995660 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.996062 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.996475 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.996884 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.997360 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.997783 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.998183 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.998613 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.999071 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.999490 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:07.999914 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.000405 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.000758 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.001107 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.001462 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.001824 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.002237 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.002621 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.002990 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.003395 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.003763 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.004117 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.004469 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.004937 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.005345 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.005796 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.006199 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.006594 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.006995 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.007494 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.007899 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.008305 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.008697 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.009089 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.009486 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.009883 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.010641 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.011440 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.011593 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.012032 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.012481 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.012870 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.013255 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.013626 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.014012 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.014397 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.014771 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.015227 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.015633 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.016005 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.016382 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.016756 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.017128 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.017638 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.017960 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.018362 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.018735 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.019144 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.019534 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.019914 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.020308 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.020686 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.021062 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.021443 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.021815 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.022190 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.022550 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.022945 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.023358 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.023738 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.024110 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.024472 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.024863 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.025301 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.025697 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.026104 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.026478 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.026869 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.027368 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.027855 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.028235 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.028644 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.029029 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.029405 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.029785 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.030149 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:47:08.030454 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129804) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:47:08.097235 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO dbcounter [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Registered counter for database nova_api Aug 30 00:47:08.119829 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_db.sqlalchemy.engines [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:47:08.127205 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writer thread running {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:47:08.185473 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO dbcounter [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Registered counter for database nova_api Aug 30 00:47:08.185961 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.context [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a8879ab-9ba0-40de-b078-fe33ec09ccfb(cell1) {{(pid=129803) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 00:47:08.189849 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:47:08.190324 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:47:08.191935 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:47:08.192646 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:47:08.193093 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:47:08.195139 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:47:08.197105 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO dbcounter [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Registered counter for database nova_cell0 Aug 30 00:47:08.201417 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO dbcounter [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Registered counter for database nova_cell1 Aug 30 00:47:08.205581 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_db.sqlalchemy.engines [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:47:08.208765 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_db.sqlalchemy.engines [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:47:08.211597 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_db.sqlalchemy.engines [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:47:08.214302 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writer thread running {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:47:08.219176 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writer thread running {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:47:08.220636 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writer thread running {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:47:08.269231 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.context [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a8879ab-9ba0-40de-b078-fe33ec09ccfb(cell1) {{(pid=129804) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 00:47:08.273166 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_concurrency.lockutils [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:47:08.273626 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_concurrency.lockutils [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:47:08.275218 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_concurrency.lockutils [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:47:08.276016 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_concurrency.lockutils [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:47:08.276804 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_concurrency.lockutils [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:47:08.279206 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_concurrency.lockutils [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129804) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:47:08.281049 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO dbcounter [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Registered counter for database nova_cell0 Aug 30 00:47:08.286570 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO dbcounter [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Registered counter for database nova_cell1 Aug 30 00:47:08.294098 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_db.sqlalchemy.engines [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:47:08.297691 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_db.sqlalchemy.engines [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:47:08.299783 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writer thread running {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:47:08.363297 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO dbcounter [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Registered counter for database nova_cell0 Aug 30 00:47:08.372522 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_db.sqlalchemy.engines [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129803) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:47:08.378567 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writer thread running {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:47:08.439441 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writer thread running {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:47:08.448912 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO dbcounter [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Registered counter for database nova_cell0 Aug 30 00:47:08.458431 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG oslo_db.sqlalchemy.engines [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129804) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:47:08.463917 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writer thread running {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:47:08.712841 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: WARNING keystonemiddleware.auth_token [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:47:08.720301 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: WARNING keystonemiddleware.auth_token [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:47:08.775048 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: WARNING keystonemiddleware.auth_token [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:47:08.782614 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: WARNING keystonemiddleware.auth_token [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:47:09.061177 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: WARNING keystonemiddleware.auth_token [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:47:09.067503 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: WARNING keystonemiddleware.auth_token [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:47:09.073028 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647a83389c0 pid: 129803 (default app) Aug 30 00:47:09.075300 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:47:09.076538 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001933 Aug 30 00:47:09.076944 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Tue Aug 30 00:47:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:47:09.127595 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: WARNING keystonemiddleware.auth_token [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:47:09.133656 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: WARNING keystonemiddleware.auth_token [None req-8fc53a4c-7c1b-45fb-add9-6d29fba8e788 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:47:09.138931 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647a83389c0 pid: 129804 (default app) Aug 30 00:48:28.114785 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:28.115868 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 30 00:48:28.116245 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:28.129452 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writing DB stats nova_api:SELECT=3 {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:28.130602 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writing DB stats nova_cell0:SELECT=3 {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:28.131627 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writing DB stats nova_cell1:SELECT=3 {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:28.132619 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writing DB stats nova_cell0:SELECT=3 {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:29.010883 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-d263068b-7001-43b2-bd3f-2bb478b1b10d admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:29.045032 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-d263068b-7001-43b2-bd3f-2bb478b1b10d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920689 Aug 30 00:48:29.051157 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Aug 30 00:48:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:31.391632 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:31.398593 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-23af11b5-06a3-4888-84df-53f5e2dfad45 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.007498 Aug 30 00:48:31.415784 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:31 2022] GET /compute/v2.1 => generated 388 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:31.849482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-9246f2af-aa8c-4928-8daf-01e42d85dd59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:31.900718 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-9246f2af-aa8c-4928-8daf-01e42d85dd59 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495075 Aug 30 00:48:31.901290 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:48:31.915271 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_api:SELECT=3 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:31.916024 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_cell0:SELECT=3 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:31.917060 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_cell1:SELECT=3 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:31.917948 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:32.127437 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-5143643a-5316-4cd7-a6a9-3c9344cd7adf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:32.197218 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-5143643a-5316-4cd7-a6a9-3c9344cd7adf admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287481 Aug 30 00:48:32.198114 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 30 00:48:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:34.590299 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-9246f2af-aa8c-4928-8daf-01e42d85dd59 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:34.591674 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-9246f2af-aa8c-4928-8daf-01e42d85dd59 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Aug 30 00:48:34.592338 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:35.244331 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-5df82fad-20da-4961-9b11-0973ef2374be admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "vcpus": 1, "ram": 512, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:35.284020 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-5df82fad-20da-4961-9b11-0973ef2374be admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.685257 Aug 30 00:48:35.284471 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:48:35.296906 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-7ed67f9b-cbe5-46ff-899e-e9f99c3dadfb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:35.334990 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-7ed67f9b-cbe5-46ff-899e-e9f99c3dadfb admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041950 Aug 30 00:48:35.343027 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 30 00:48:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:37.760383 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-5df82fad-20da-4961-9b11-0973ef2374be admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:37.761409 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-5df82fad-20da-4961-9b11-0973ef2374be admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 30 00:48:37.761886 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:48:38.172547 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-32af8db1-6337-4eee-b582-bfc445cfcc9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:38.192822 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-32af8db1-6337-4eee-b582-bfc445cfcc9e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424755 Aug 30 00:48:38.193376 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:48:38.205935 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-a14f8c2e-b89c-4b13-bb14-b5df5da9daf0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:38.231772 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-a14f8c2e-b89c-4b13-bb14-b5df5da9daf0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029486 Aug 30 00:48:38.247035 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 30 00:48:38 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:40.607358 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-32af8db1-6337-4eee-b582-bfc445cfcc9e admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:40.608961 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-32af8db1-6337-4eee-b582-bfc445cfcc9e admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 30 00:48:40.609818 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:41.073490 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-3423ff0f-568b-4eb2-a5a5-d255a0365b25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "rxtx_factor": 1.0}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:41.096852 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-3423ff0f-568b-4eb2-a5a5-d255a0365b25 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481462 Aug 30 00:48:41.097537 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:48:41.110025 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-f7f258bc-af3b-45ee-aa3c-f4de8dd682be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:41.136287 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-f7f258bc-af3b-45ee-aa3c-f4de8dd682be admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030195 Aug 30 00:48:41.137114 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 30 00:48:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:48:43.486162 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-3423ff0f-568b-4eb2-a5a5-d255a0365b25 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:43.488057 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-3423ff0f-568b-4eb2-a5a5-d255a0365b25 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002225 Aug 30 00:48:43.488576 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:43.933542 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-932a389d-8d64-4864-bee3-1d4b9bf1a677 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:43.955239 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-932a389d-8d64-4864-bee3-1d4b9bf1a677 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460088 Aug 30 00:48:43.955920 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:48:43.969302 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-89e34081-3640-4dac-a443-1089573c5b4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:43.999739 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-89e34081-3640-4dac-a443-1089573c5b4b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033993 Aug 30 00:48:44.000784 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1336 bytes} [Tue Aug 30 00:48:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:46.385859 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-932a389d-8d64-4864-bee3-1d4b9bf1a677 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:46.387641 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-932a389d-8d64-4864-bee3-1d4b9bf1a677 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002299 Aug 30 00:48:46.388086 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:48:46.853510 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-c0e8c63d-22ce-49a2-af6b-df28ca09a56d admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:46.880217 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-c0e8c63d-22ce-49a2-af6b-df28ca09a56d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.485410 Aug 30 00:48:46.880805 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Aug 30 00:48:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:48:49.340010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-932a389d-8d64-4864-bee3-1d4b9bf1a677 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:49.340981 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-932a389d-8d64-4864-bee3-1d4b9bf1a677 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Aug 30 00:48:49.341430 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:49.818526 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-d805af04-bb9a-4a8e-80fa-9931dc8abf1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:49.840825 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-d805af04-bb9a-4a8e-80fa-9931dc8abf1c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.492541 Aug 30 00:48:49.841407 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:48:49.855107 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-db314588-5e86-47fc-95d5-6b325834fc8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:49.884419 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-db314588-5e86-47fc-95d5-6b325834fc8a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032219 Aug 30 00:48:49.884419 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 30 00:48:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:52.227718 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-d805af04-bb9a-4a8e-80fa-9931dc8abf1c admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:52.228756 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-d805af04-bb9a-4a8e-80fa-9931dc8abf1c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Aug 30 00:48:52.229176 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:52.669416 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-52ad2f3e-30dd-4dc7-af7c-faa4727daee1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "id": "2", "disk": 20, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:52.695573 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-52ad2f3e-30dd-4dc7-af7c-faa4727daee1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.458445 Aug 30 00:48:52.703127 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:48:52.709071 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-3e5b7218-1fa5-4121-b5f1-d1a4c438d6f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:52.736117 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-3e5b7218-1fa5-4121-b5f1-d1a4c438d6f9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031067 Aug 30 00:48:52.736798 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 30 00:48:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:55.163300 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-52ad2f3e-30dd-4dc7-af7c-faa4727daee1 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:55.164500 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-52ad2f3e-30dd-4dc7-af7c-faa4727daee1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 30 00:48:55.165049 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:55.579600 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-65a62db6-df4b-4f31-ac90-dce1b8d5440c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:55.604504 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-65a62db6-df4b-4f31-ac90-dce1b8d5440c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.432851 Aug 30 00:48:55.605485 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:48:55.619742 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-e0173c46-f626-47a7-b9a8-43301d103a93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:55.649191 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-e0173c46-f626-47a7-b9a8-43301d103a93 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033544 Aug 30 00:48:55.649891 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 30 00:48:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:48:58.147223 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-65a62db6-df4b-4f31-ac90-dce1b8d5440c admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:48:58.148433 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-65a62db6-df4b-4f31-ac90-dce1b8d5440c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 30 00:48:58.149629 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:48:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:48:58.616081 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-84907666-be78-4b4e-bfce-03c4a860d13d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:58.621968 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:48:58.639820 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-84907666-be78-4b4e-bfce-03c4a860d13d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.483786 Aug 30 00:48:58.640693 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:48:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:48:58.653038 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-64f03684-0fb0-4a98-a950-93ea1520bf71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:48:58.680371 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-64f03684-0fb0-4a98-a950-93ea1520bf71 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031034 Aug 30 00:48:58.691271 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 30 00:48:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:01.064734 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-84907666-be78-4b4e-bfce-03c4a860d13d admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:01.065665 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-84907666-be78-4b4e-bfce-03c4a860d13d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 30 00:49:01.066210 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:49:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:01.513866 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-e905f4ef-f2af-49bf-b1e5-7a6263ac7539 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "disk": 160, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:49:01.535962 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-e905f4ef-f2af-49bf-b1e5-7a6263ac7539 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463718 Aug 30 00:49:01.546786 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1283 bytes} [Tue Aug 30 00:49:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:49:01.549941 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-8e18ccaa-5fd7-46bd-93c9-676de90d5796 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:49:01.576317 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-8e18ccaa-5fd7-46bd-93c9-676de90d5796 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030414 Aug 30 00:49:01.576899 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1333 bytes} [Tue Aug 30 00:49:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:49:20.741354 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-e905f4ef-f2af-49bf-b1e5-7a6263ac7539 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:20.743065 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-e905f4ef-f2af-49bf-b1e5-7a6263ac7539 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002503 Aug 30 00:49:20.743735 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:20.757905 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:21.177530 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-1668abcc-a89f-4885-8dd8-05e0ea63c565 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:21.195570 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-1668abcc-a89f-4885-8dd8-05e0ea63c565 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.442138 Aug 30 00:49:21.196092 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Aug 30 00:49:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:49:22.269176 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-e905f4ef-f2af-49bf-b1e5-7a6263ac7539 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:22.270206 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-e905f4ef-f2af-49bf-b1e5-7a6263ac7539 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 30 00:49:22.270646 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:49:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:22.843747 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-c3c36c8f-2164-47d5-a8e3-4fb1266a95f7 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:22.849649 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.wsgi [None req-c3c36c8f-2164-47d5-a8e3-4fb1266a95f7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-c3c36c8f-2164-47d5-a8e3-4fb1266a95f7 admin admin] Request method failure captured: Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Accept: application/json Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Accept-Encoding: gzip, deflate Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Connection: keep-alive Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Content-Length: 0 Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Host: 10.222.0.17 Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Openstack-Api-Version: compute 2.90 Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Openstack-System-Scope: None Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: User-Agent: python-novaclient Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Auth-Token: gAAAAABjDV6SH3hkMNInBVGdelKTXDM3tlmKNYFSu1QG8iJk_WZxLczGMh9swBbTtGTrTmd26FsyTRxkktYLqncyRbiQprzH0BjUk7aecKV2665ZiKQ_DuZBp_EFgec-6TADPhpslW_CpLtb70vnjjJd9kCxvuBkL7fI9OKkcBsa2zWE2RwSvlw Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Domain-Id: None Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Domain-Name: None Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Identity-Status: Confirmed Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Is-Admin-Project: True Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Domain-Id: default Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Domain-Name: Default Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Name: admin Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Role: admin,member,reader Aug 30 00:49:22.852974 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Roles: admin,member,reader Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa5e798ada384a4f94fc4eb7a83dd47f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}] Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant: admin Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant-Name: admin Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User: admin Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Domain-Id: default Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Domain-Name: Default Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Id: 65d191ebc1aa4d0ebd90e4982cc77782 Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Name: admin Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: method: > Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: exception: Flavor 42 could not be found. Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: action_args: {'id': '42'} Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:49:22.854588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:22.855646 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.856970 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-c3c36c8f-2164-47d5-a8e3-4fb1266a95f7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=129804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:49:22.858200 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-c3c36c8f-2164-47d5-a8e3-4fb1266a95f7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.448288 Aug 30 00:49:22.858200 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 30 00:49:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:49:22.864739 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-ec2afca3-31e3-4749-b814-71cb61f2ddcf admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:22.869046 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:49:22.891682 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-ec2afca3-31e3-4749-b814-71cb61f2ddcf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030646 Aug 30 00:49:22.892289 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 30 00:49:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:49:22.903942 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-1482385c-cded-45c1-b31b-cb1c76f73740 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:22.928457 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-1482385c-cded-45c1-b31b-cb1c76f73740 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029277 Aug 30 00:49:22.929010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 30 00:49:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:49:22.942386 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-f113787b-ac1e-456e-a383-b6309245a3f9 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:22.952929 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.wsgi [None req-f113787b-ac1e-456e-a383-b6309245a3f9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-f113787b-ac1e-456e-a383-b6309245a3f9 admin admin] Request method failure captured: Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Accept: application/json Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Accept-Encoding: gzip, deflate Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Connection: keep-alive Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Content-Length: 0 Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Host: 10.222.0.17 Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Openstack-Api-Version: compute 2.90 Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Openstack-System-Scope: None Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: User-Agent: python-novaclient Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Auth-Token: gAAAAABjDV6SH3hkMNInBVGdelKTXDM3tlmKNYFSu1QG8iJk_WZxLczGMh9swBbTtGTrTmd26FsyTRxkktYLqncyRbiQprzH0BjUk7aecKV2665ZiKQ_DuZBp_EFgec-6TADPhpslW_CpLtb70vnjjJd9kCxvuBkL7fI9OKkcBsa2zWE2RwSvlw Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Domain-Id: None Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Domain-Name: None Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Identity-Status: Confirmed Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Is-Admin-Project: True Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Domain-Id: default Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Domain-Name: Default Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Name: admin Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Role: admin,member,reader Aug 30 00:49:22.958601 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Roles: admin,member,reader Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa5e798ada384a4f94fc4eb7a83dd47f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}] Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant: admin Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant-Name: admin Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User: admin Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Domain-Id: default Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Domain-Name: Default Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Id: 65d191ebc1aa4d0ebd90e4982cc77782 Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Name: admin Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: method: > Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: exception: Flavor 42 could not be found. Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: action_args: {'id': '42'} Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:49:22.961322 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:22.962320 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:22.964029 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-f113787b-ac1e-456e-a383-b6309245a3f9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=129803) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:49:22.965269 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-f113787b-ac1e-456e-a383-b6309245a3f9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.024625 Aug 30 00:49:22.965269 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 30 00:49:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:49:24.001772 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-1482385c-cded-45c1-b31b-cb1c76f73740 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:24.003279 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-1482385c-cded-45c1-b31b-cb1c76f73740 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Aug 30 00:49:24.003835 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:24.593464 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-b0ea629c-de27-4695-8365-c5d4a8815765 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:24.599325 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.wsgi [None req-b0ea629c-de27-4695-8365-c5d4a8815765 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-b0ea629c-de27-4695-8365-c5d4a8815765 admin admin] Request method failure captured: Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Accept: application/json Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Accept-Encoding: gzip, deflate Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Connection: keep-alive Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Content-Length: 0 Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Host: 10.222.0.17 Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Openstack-Api-Version: compute 2.90 Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Openstack-System-Scope: None Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: User-Agent: python-novaclient Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Auth-Token: gAAAAABjDV6THsIH0v-U0NjX6Hyfs1eRS-wzd40hsJ0eclA4IK2sLC5Mv4__SoOBZaj2idN-VtHM1eVsWlte3ZuHdw4Vld2MEzRNARodN5iVO5Pta4aGO0wZSy7uEQ_jFQyLSU9Hxiup2LoPzRhoWxjhe4ZlVsbI75RQZH0lBkaovJnBZTQqVK4 Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Domain-Id: None Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Domain-Name: None Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Identity-Status: Confirmed Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Is-Admin-Project: True Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Domain-Id: default Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Domain-Name: Default Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Name: admin Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Role: admin,member,reader Aug 30 00:49:24.600820 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Roles: admin,member,reader Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa5e798ada384a4f94fc4eb7a83dd47f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}] Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant: admin Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant-Name: admin Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User: admin Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Domain-Id: default Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Domain-Name: Default Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Id: 65d191ebc1aa4d0ebd90e4982cc77782 Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Name: admin Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: method: > Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: exception: Flavor 84 could not be found. Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: action_args: {'id': '84'} Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:49:24.602379 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:24.605361 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.606703 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-b0ea629c-de27-4695-8365-c5d4a8815765 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=129803) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:49:24.608135 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-b0ea629c-de27-4695-8365-c5d4a8815765 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.456855 Aug 30 00:49:24.608135 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 30 00:49:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 458 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:49:24.612703 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-fe7f1b8d-7a60-48ef-bf14-5fdcbe3bc721 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:24.628408 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-fe7f1b8d-7a60-48ef-bf14-5fdcbe3bc721 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019386 Aug 30 00:49:24.628946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 30 00:49:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:49:24.640858 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-f7b14f2c-8605-4b81-b0c3-0cd168a78f23 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:24.656610 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-f7b14f2c-8605-4b81-b0c3-0cd168a78f23 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019391 Aug 30 00:49:24.657118 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 30 00:49:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:49:24.666651 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-33b81a2c-ab0a-4eb9-9cfe-213b00f2e0c8 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:24.672301 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.wsgi [None req-33b81a2c-ab0a-4eb9-9cfe-213b00f2e0c8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-33b81a2c-ab0a-4eb9-9cfe-213b00f2e0c8 admin admin] Request method failure captured: Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Accept: application/json Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Accept-Encoding: gzip, deflate Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Connection: keep-alive Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Content-Length: 0 Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Host: 10.222.0.17 Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Openstack-Api-Version: compute 2.90 Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Openstack-System-Scope: None Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: User-Agent: python-novaclient Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Auth-Token: gAAAAABjDV6THsIH0v-U0NjX6Hyfs1eRS-wzd40hsJ0eclA4IK2sLC5Mv4__SoOBZaj2idN-VtHM1eVsWlte3ZuHdw4Vld2MEzRNARodN5iVO5Pta4aGO0wZSy7uEQ_jFQyLSU9Hxiup2LoPzRhoWxjhe4ZlVsbI75RQZH0lBkaovJnBZTQqVK4 Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Domain-Id: None Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Domain-Name: None Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Identity-Status: Confirmed Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Is-Admin-Project: True Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Domain-Id: default Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Domain-Name: Default Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Name: admin Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Role: admin,member,reader Aug 30 00:49:24.673801 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Roles: admin,member,reader Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa5e798ada384a4f94fc4eb7a83dd47f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}] Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant: admin Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant-Name: admin Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User: admin Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Domain-Id: default Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Domain-Name: Default Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Id: 65d191ebc1aa4d0ebd90e4982cc77782 Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Name: admin Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: method: > Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: exception: Flavor 84 could not be found. Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: action_args: {'id': '84'} Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:49:24.675342 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:24.676251 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:24.677851 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-33b81a2c-ab0a-4eb9-9cfe-213b00f2e0c8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=129804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:49:24.679556 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-33b81a2c-ab0a-4eb9-9cfe-213b00f2e0c8 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012332 Aug 30 00:49:24.679556 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Aug 30 00:49:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:49:25.690836 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-f7b14f2c-8605-4b81-b0c3-0cd168a78f23 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:25.691900 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-f7b14f2c-8605-4b81-b0c3-0cd168a78f23 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 30 00:49:25.692314 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:26.276265 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-8af21f82-8a92-4f18-af69-ba348db5370d admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:26.285467 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.wsgi [None req-8af21f82-8a92-4f18-af69-ba348db5370d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-8af21f82-8a92-4f18-af69-ba348db5370d admin admin] Request method failure captured: Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Accept: application/json Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Accept-Encoding: gzip, deflate Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Connection: keep-alive Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Content-Length: 0 Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Host: 10.222.0.17 Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Openstack-Api-Version: compute 2.90 Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Openstack-System-Scope: None Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: User-Agent: python-novaclient Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Auth-Token: gAAAAABjDV6VEfR7_psRWRebL-SoDFe6t9Uf3uXSU33aRz6UNsO1WS7FZsQ4WeOxqwC6LqhKWPdypuO08ZbbS3xsINPhsjCiUF8NpJZWZ0iQKg6kNwPBrEeKd5DO9mw5hHXVML1_P3lWJ4lG19FmPiCKkccs8AZZlCFeg5po5Ntb40bAMijfLH4 Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Domain-Id: None Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Domain-Name: None Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Identity-Status: Confirmed Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Is-Admin-Project: True Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Domain-Id: default Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Domain-Name: Default Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Project-Name: admin Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Role: admin,member,reader Aug 30 00:49:26.287946 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Roles: admin,member,reader Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa5e798ada384a4f94fc4eb7a83dd47f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}] Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant: admin Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-Tenant-Name: admin Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User: admin Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Domain-Id: default Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Domain-Name: Default Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Id: 65d191ebc1aa4d0ebd90e4982cc77782 Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: X-User-Name: admin Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: method: > Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: exception: Flavor 451 could not be found. Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: action_args: {'id': '451'} Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:49:26.289482 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:26.290370 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.292010 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-8af21f82-8a92-4f18-af69-ba348db5370d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=129804) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:49:26.293315 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-8af21f82-8a92-4f18-af69-ba348db5370d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.459808 Aug 30 00:49:26.293315 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 30 00:49:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:49:26.300622 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-281b3728-82e0-4cd2-ab13-a0b34e8bcd7d admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:26.315947 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-281b3728-82e0-4cd2-ab13-a0b34e8bcd7d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018994 Aug 30 00:49:26.316472 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 30 00:49:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:49:26.326519 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:26.342980 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020335 Aug 30 00:49:26.343545 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Aug 30 00:49:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:49:26.352927 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-2bb1f325-f8b7-46a3-9ca2-8bb492ddcc9a admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:26.358726 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.wsgi [None req-2bb1f325-f8b7-46a3-9ca2-8bb492ddcc9a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-2bb1f325-f8b7-46a3-9ca2-8bb492ddcc9a admin admin] Request method failure captured: Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Accept: application/json Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Accept-Encoding: gzip, deflate Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Connection: keep-alive Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Content-Length: 0 Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Host: 10.222.0.17 Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Openstack-Api-Version: compute 2.90 Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Openstack-System-Scope: None Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: User-Agent: python-novaclient Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Auth-Token: gAAAAABjDV6VEfR7_psRWRebL-SoDFe6t9Uf3uXSU33aRz6UNsO1WS7FZsQ4WeOxqwC6LqhKWPdypuO08ZbbS3xsINPhsjCiUF8NpJZWZ0iQKg6kNwPBrEeKd5DO9mw5hHXVML1_P3lWJ4lG19FmPiCKkccs8AZZlCFeg5po5Ntb40bAMijfLH4 Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Domain-Id: None Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Domain-Name: None Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Identity-Status: Confirmed Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Is-Admin-Project: True Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Domain-Id: default Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Domain-Name: Default Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Project-Name: admin Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Role: admin,member,reader Aug 30 00:49:26.360249 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Roles: admin,member,reader Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa5e798ada384a4f94fc4eb7a83dd47f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa5e798ada384a4f94fc4eb7a83dd47f"}]}] Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant: admin Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant-Id: aa5e798ada384a4f94fc4eb7a83dd47f Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-Tenant-Name: admin Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User: admin Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Domain-Id: default Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Domain-Name: Default Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Id: 65d191ebc1aa4d0ebd90e4982cc77782 Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: X-User-Name: admin Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: method: > Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: exception: Flavor 451 could not be found. Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: action_args: {'id': '451'} Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:49:26.361734 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:26.362690 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: ERROR nova.api.openstack.wsgi Aug 30 00:49:26.364059 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-2bb1f325-f8b7-46a3-9ca2-8bb492ddcc9a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=129803) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:49:26.365304 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-2bb1f325-f8b7-46a3-9ca2-8bb492ddcc9a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012308 Aug 30 00:49:26.365304 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 30 00:49:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 00:49:27.357380 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:27.358693 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Aug 30 00:49:27.359252 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:49:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:27.944547 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-20a28c4f-6970-41a8-9508-14538c991751 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:49:27.965986 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-20a28c4f-6970-41a8-9508-14538c991751 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.469961 Aug 30 00:49:27.966531 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 30 00:49:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:49:28.976947 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:28.977998 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 30 00:49:28.978404 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:49:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:29.576518 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-0bd33a76-01d4-48bf-9002-e3fd25ffd5d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:49:29.597500 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-0bd33a76-01d4-48bf-9002-e3fd25ffd5d5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.476523 Aug 30 00:49:29.598050 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 30 00:49:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:49:30.596379 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:30.597391 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 30 00:49:30.597791 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:49:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:31.184455 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-5578e163-595f-4f42-bb37-359742245d1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:49:31.206625 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-5578e163-595f-4f42-bb37-359742245d1b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.464833 Aug 30 00:49:31.207199 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 30 00:49:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:49:32.214711 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:32.215777 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Aug 30 00:49:32.216185 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:49:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:32.782402 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-26e7e01b-edaa-4d8a-a224-5aa3377e6b28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:49:32.803047 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-26e7e01b-edaa-4d8a-a224-5aa3377e6b28 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.446071 Aug 30 00:49:32.803598 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Aug 30 00:49:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:49:33.810556 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:33.811597 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 30 00:49:33.812011 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:49:34.371091 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-ed004974-1a29-46f7-9dba-320cd1ded748 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:49:34.391825 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-ed004974-1a29-46f7-9dba-320cd1ded748 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.441298 Aug 30 00:49:34.392399 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Tue Aug 30 00:49:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:50:29.115346 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:50:29.116375 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-17de4d12-dd1e-43fa-a123-5335c02862de admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Aug 30 00:50:29.116798 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 931 bytes} [Tue Aug 30 00:50:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:50:29.127866 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:29.565646 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-fab33b85-f087-475d-ae53-633a435eb88f admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:50:29.586500 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-fab33b85-f087-475d-ae53-633a435eb88f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.463274 Aug 30 00:50:29.587040 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1292 bytes} [Tue Aug 30 00:50:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:50:29.608437 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG dbcounter [-] [129804] Writing DB stats nova_api:SELECT=14 {{(pid=129804) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:50:29.612179 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-695a379f-2711-4389-9282-096b74521c84 admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:50:29.619867 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-695a379f-2711-4389-9282-096b74521c84 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012874 Aug 30 00:50:29.620569 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1283 bytes} [Tue Aug 30 00:50:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:50:29.632489 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-cded1924-32e5-45f8-a2a8-983ca5a9a754 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:50:29.640604 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-cded1924-32e5-45f8-a2a8-983ca5a9a754 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011828 Aug 30 00:50:29.641124 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1286 bytes} [Tue Aug 30 00:50:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:50:29.654588 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:50:29.662623 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012970 Aug 30 00:50:29.663292 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1286 bytes} [Tue Aug 30 00:50:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:50:29.675939 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-e7b0e48e-6aff-4118-bc89-8d6b6546c94f admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:50:29.684079 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-e7b0e48e-6aff-4118-bc89-8d6b6546c94f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011921 Aug 30 00:50:29.684614 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1283 bytes} [Tue Aug 30 00:50:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:53:39.064735 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:53:39.065768 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 30 00:53:39.066163 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:53:39.208541 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_api:SELECT=6 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:39.395707 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-9e818fc5-141b-443d-96ab-a2eaf19623e9 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:53:39.399384 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-9e818fc5-141b-443d-96ab-a2eaf19623e9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:53:39.399853 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-9e818fc5-141b-443d-96ab-a2eaf19623e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:53:39.400268 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-9e818fc5-141b-443d-96ab-a2eaf19623e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:53:39.401090 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-9e818fc5-141b-443d-96ab-a2eaf19623e9 admin admin] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:53:39.401520 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-9e818fc5-141b-443d-96ab-a2eaf19623e9 admin admin] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:53:39.401927 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-9e818fc5-141b-443d-96ab-a2eaf19623e9 admin admin] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:53:39.437122 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-9e818fc5-141b-443d-96ab-a2eaf19623e9 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.231044 Aug 30 00:53:39.437691 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 30 00:53:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:53:40.273540 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:53:40.274921 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Aug 30 00:53:40.275489 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:53:40.475272 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-4771cf31-8522-4f88-913c-568b81b51c04 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:53:40.478655 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-4771cf31-8522-4f88-913c-568b81b51c04 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:53:40.479236 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-4771cf31-8522-4f88-913c-568b81b51c04 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:53:40.479756 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-4771cf31-8522-4f88-913c-568b81b51c04 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:53:40.480533 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-4771cf31-8522-4f88-913c-568b81b51c04 admin admin] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:53:40.480970 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-4771cf31-8522-4f88-913c-568b81b51c04 admin admin] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:53:40.481375 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-4771cf31-8522-4f88-913c-568b81b51c04 admin admin] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:53:40.501050 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-4771cf31-8522-4f88-913c-568b81b51c04 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083640 Aug 30 00:53:40.501632 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 30 00:53:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:53:51.748850 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:53:51.749857 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Aug 30 00:53:51.750265 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:53:51.898056 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_cell0:SELECT=4 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.898901 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_cell1:SELECT=4 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.899792 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG dbcounter [-] [129803] Writing DB stats nova_api:SELECT=8 {{(pid=129803) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:53:51.949802 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-15d56557-65fd-4f6c-b329-96f531153f24 admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:53:51.953318 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-15d56557-65fd-4f6c-b329-96f531153f24 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:53:51.953781 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-15d56557-65fd-4f6c-b329-96f531153f24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:53:51.954200 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-15d56557-65fd-4f6c-b329-96f531153f24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:53:51.954894 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-15d56557-65fd-4f6c-b329-96f531153f24 admin admin] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:53:51.955364 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-15d56557-65fd-4f6c-b329-96f531153f24 admin admin] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:53:51.955752 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-15d56557-65fd-4f6c-b329-96f531153f24 admin admin] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:53:51.981729 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-15d56557-65fd-4f6c-b329-96f531153f24 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091058 Aug 30 00:53:51.982593 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 30 00:53:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:53:52.862794 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: DEBUG nova.api.openstack.wsgi [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] Calling method '>' {{(pid=129804) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:53:52.863838 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: INFO nova.api.openstack.requestlog [None req-9004d34d-85e2-4964-a60c-1d0df0a8baff admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 30 00:53:52.864237 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: [pid: 129804|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Aug 30 00:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:53:53.074450 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG nova.api.openstack.wsgi [None req-1f3238ae-9e1d-4bd1-b726-83299776998b admin admin] Calling method '>' {{(pid=129803) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:53:53.078469 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-1f3238ae-9e1d-4bd1-b726-83299776998b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:53:53.078948 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-1f3238ae-9e1d-4bd1-b726-83299776998b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:53:53.079407 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-1f3238ae-9e1d-4bd1-b726-83299776998b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:53:53.080122 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-1f3238ae-9e1d-4bd1-b726-83299776998b admin admin] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:53:53.080570 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-1f3238ae-9e1d-4bd1-b726-83299776998b admin admin] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:53:53.080988 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: DEBUG oslo_concurrency.lockutils [None req-1f3238ae-9e1d-4bd1-b726-83299776998b admin admin] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129803) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:53:53.104208 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: INFO nova.api.openstack.requestlog [None req-1f3238ae-9e1d-4bd1-b726-83299776998b admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.099368 Aug 30 00:53:53.104768 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: [pid: 129803|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Aug 30 00:53:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:54:51.970760 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: Tue Aug 30 00:54:51 2022 - graceful shutdown triggered... Aug 30 00:54:51.970887 dv-cinder-815746-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 00:54:51.971877 dv-cinder-815746-8-iscsi devstack@n-api.service[129803]: Gracefully killing worker 1 (pid: 129803)... Aug 30 00:54:51.972267 dv-cinder-815746-8-iscsi devstack@n-api.service[129804]: Gracefully killing worker 2 (pid: 129804)... Aug 30 00:54:52.973014 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: worker 1 buried after 1 seconds Aug 30 00:54:52.973014 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: worker 2 buried after 1 seconds Aug 30 00:54:52.973014 dv-cinder-815746-8-iscsi devstack@n-api.service[129802]: goodbye to uWSGI. Aug 30 00:54:52.974611 dv-cinder-815746-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 00:54:52.975213 dv-cinder-815746-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 00:54:52.978630 dv-cinder-815746-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 00:54:52.988771 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 00:54:52 2022] *** Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: nodename: dv-cinder-815746-8-iscsi Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: machine: x86_64 Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: clock source: unix Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: pcre jit disabled Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: detected number of CPU cores: 4 Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: current working directory: / Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: detected binary path: /usr/bin/uwsgi-core Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: your processes number limit is 47680 Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: your memory page size is 4096 bytes Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: detected max file descriptor number: 2048 Aug 30 00:54:52.990907 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: lock engine: pthread robust mutexes Aug 30 00:54:52.992011 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: thunder lock: enabled Aug 30 00:54:52.992011 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 00:54:52.992011 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 00:54:53.031074 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: Python main interpreter initialized at 0x55d3e4f999c0 Aug 30 00:54:53.031074 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: python threads support enabled Aug 30 00:54:53.031074 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: your server socket listen backlog is limited to 100 connections Aug 30 00:54:53.031074 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: your mercy for graceful operations on workers is 90 seconds Aug 30 00:54:53.031565 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 00:54:53.031565 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: *** Operational MODE: preforking *** Aug 30 00:54:53.031811 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: *** uWSGI is running in multiple interpreter mode *** Aug 30 00:54:53.031811 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: spawned uWSGI master process (pid: 144758) Aug 30 00:54:53.032064 dv-cinder-815746-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 00:54:53.032606 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: spawned uWSGI worker 1 (pid: 144776, cores: 1) Aug 30 00:54:53.033144 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: spawned uWSGI worker 2 (pid: 144777, cores: 1) Aug 30 00:54:53.033312 dv-cinder-815746-8-iscsi devstack@n-api.service[144758]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 00:54:53.717304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 00:54:53.735095 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 00:54:54.879148 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:54:54.879148 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: from cryptography.utils import int_from_bytes Aug 30 00:54:54.879873 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:54:54.879873 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: from cryptography.utils import int_from_bytes Aug 30 00:54:54.905605 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:54:54.905605 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: from cryptography.utils import int_from_bytes Aug 30 00:54:54.906157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:54:54.906157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: from cryptography.utils import int_from_bytes Aug 30 00:54:57.371459 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:54:57.372421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:54:57.372421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:54:57.372715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:54:57.372853 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:54:57.373283 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.373571 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.373861 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.374181 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.374677 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.375051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.375335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.375692 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.376022 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.376260 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.376603 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.376928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815746-8-iscsi {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.377058 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:54:57.377464 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.377552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:54:57.377637 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.377849 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.377954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:54:57.378256 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.378514 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:54:57.378609 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:54:57.378783 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.378985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.379254 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.379573 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.379870 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.380028 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.380156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.380372 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.380684 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.380855 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.380960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.381333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.381566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.381879 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.382295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.382554 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.382681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.383058 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.383306 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.383501 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.383937 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.384051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.384441 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.384672 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815746-8-iscsi {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.384844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.385083 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.385411 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.385557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.385711 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.385928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815746-8-iscsi {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.386262 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.386405 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.386628 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.386752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.386947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.387180 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.387275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.387359 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.387670 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.387820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.387925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.388167 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.388301 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.388387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.388616 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.388728 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.388941 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.389070 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.389204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.389334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.389567 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.389880 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.390103 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.390371 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.390614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.390927 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.391065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.391275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395172 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815746-8-iscsi {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395762 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.395843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.396005 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.396092 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.396166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.396246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.396246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.396402 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.396547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.397883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.398060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.398242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.398401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.398648 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.398813 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.398961 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.399314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.399314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.399865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.400112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.400112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.400563 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.400791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.401020 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.401271 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.401500 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.401719 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.401948 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.402216 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.402447 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.402666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.402666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.407191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.407398 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.407398 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.407691 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.407867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.408025 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.408179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.408340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.408340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.408646 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.408849 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.409004 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.409147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.409298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.409443 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.409595 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.409746 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.409908 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.410050 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.410212 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.410363 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.410523 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.410666 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.410810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.410961 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.411156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.411308 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.411465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.411620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.411773 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.411934 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.411934 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.412210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.412360 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.412509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.412660 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.412810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.412960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.413109 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.413276 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.413445 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.413637 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.417871 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.418060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.418224 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.418864 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.419071 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.419239 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.419386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.422586 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.423416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.423572 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.423746 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.423746 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.424057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.424057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.424349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.424492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.424647 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.424799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.424945 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.425096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.425245 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.425402 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.425554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.425705 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.425866 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.426009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.426160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.426314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.426467 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.426638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.426783 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.426926 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.427087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.427087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.427468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.427618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.427618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.427902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.428953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.429112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.429258 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.429410 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.429574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.429761 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.429977 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.430131 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.430276 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.430438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.432101 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.432287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.432454 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.432599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.432751 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.432906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.433058 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.433209 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.433359 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.433523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.433671 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.433829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.433980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.434123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.434123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.434405 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.434557 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.434710 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.434860 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.435031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.435279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.435445 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.435597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.435755 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.435906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.436049 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.436190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.436355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.436507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.436667 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.436817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.436960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.437108 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.437257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.437414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.437567 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.437719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.437874 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.438024 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.438024 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.438313 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.438464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.438613 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.439197 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.439352 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.439504 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.439645 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.439796 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.439939 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.440096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.440248 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.440391 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.440391 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.440698 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.441242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.441396 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.441540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.441540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.441822 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.441964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.442136 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.442526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.442691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.442846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.442991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.443179 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.443332 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.443474 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.443616 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.443764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.443917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.444061 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.444212 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.444361 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.444503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.444651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.444863 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.445174 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.445489 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.446119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.446364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.446583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.446812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.447086 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.447086 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.447522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.447736 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.447900 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.448051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:54:57.448211 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.448354 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.448516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.448668 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.448810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.448810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.449543 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.449543 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.449831 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.449831 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.450100 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.450100 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.450414 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.450573 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.450736 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.450887 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.451422 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.451583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.451737 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.451895 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.452039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.452180 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.452322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.452716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.452883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.453028 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.453169 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.453169 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.453459 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.453608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.453764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.453907 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.453907 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.454183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.454335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.454335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.454615 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.454757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.454899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.455060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.455219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.455379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.455524 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.455687 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.455830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.455982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.456125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.456281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.456281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.456552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.456693 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.456693 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.456980 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.457136 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.457287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.457442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.457442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.457712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.457854 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.458084 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.458235 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.458384 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.458535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.458535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.458825 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.458983 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.458983 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.466484 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.466652 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.466814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.466990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.466990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.467311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.467456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.467456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.468028 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.468200 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.469490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.469771 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.469771 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.470234 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.470488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.470488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.470962 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.471305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.471305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.471702 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.473593 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.473904 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.474163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.474163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.474579 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.474746 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.474746 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.475072 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.475237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.475383 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.475535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.475535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.475926 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.476183 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.476183 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.476641 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.478789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.479115 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.479115 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.479662 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.479894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.480121 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.480358 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.480592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.480836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.481073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.481306 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.481535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.481746 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.484840 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.485023 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.485183 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.485342 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.485497 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.485651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.485809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.485809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.486082 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.486232 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.486232 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.486512 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.486664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.486820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.486974 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.487168 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.487313 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.487456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.487629 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.487781 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.488737 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.488905 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.489198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.489198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.489501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.489697 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.489859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.490003 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.490146 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.490298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.490447 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.490590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.490738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.492244 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.492462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.492646 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.492809 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.493025 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.493384 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.493562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.493738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.493897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.494042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.494042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.494358 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.494505 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.494505 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.494800 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.494949 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.495522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.495688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.495962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.496127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.496281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.496427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.496569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.496738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.496852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.496978 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.497766 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.497927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.498078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.498223 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.498430 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.498664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.498831 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.498976 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.499160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.499804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.499960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.500105 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.500257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.500401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.500543 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.500701 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.500701 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.500991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.501143 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.501291 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.501648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.501832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.501979 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.502141 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.502141 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.502435 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.502575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.502703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.503356 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.503512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.503676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.503829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.503988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.504141 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.504283 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.504479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.504673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.504673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.504968 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.505119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.505261 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.505412 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.505575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.505724 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.505888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.506037 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.506193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.506342 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.506499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.506656 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.506819 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.506970 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.507316 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.507472 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.507620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.507620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.507948 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.508182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.508182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.508528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.508840 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.508840 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.509144 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.509292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.509292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.509592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.509741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.510028 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.510202 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.510202 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.510494 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.510644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.510791 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.510949 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.510949 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.511272 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.511432 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.511590 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.511744 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.511905 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.512062 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.512231 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.512381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.512529 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.512685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.512834 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.512980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.513144 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.513409 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.513409 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.513721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.513872 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.513872 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.514153 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.514322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.514470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.514636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.514794 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.514943 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.515155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.515308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.515308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.515608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.515757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.515912 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.516069 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.516237 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.516397 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.516397 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.516688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.516837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.516837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.517132 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.517295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.517455 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.517604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.517752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.517752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.518049 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.518496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.518669 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.518822 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.518998 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.519780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.519988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.520154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.520316 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.520465 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.520615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.520771 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.520929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.521078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.521257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.521432 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.521592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.521757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.521983 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.522236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.522422 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.522584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.522743 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.522899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.523084 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.523248 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.523426 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.523951 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.524120 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.524270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.524487 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.524718 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.524958 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.525209 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.525463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.525709 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.525885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.526037 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.526195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.526363 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.526519 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.526683 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.526834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.526984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.526984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.527350 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.527498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.527663 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.527813 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.527970 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.528119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.528275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.528443 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.528601 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.528758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.528916 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.529081 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.529237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.529393 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.529557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.529706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.529853 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.529853 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.530240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.530391 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.530391 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.530691 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.530840 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.530997 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.531194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.531354 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.531503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.531650 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.531807 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.531967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.532126 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.532275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.532431 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.532602 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.532766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.532922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.533073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.533222 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.533378 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.533528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.533689 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.533839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.534108 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.534266 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.534416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.534582 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.535707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.535885 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.536038 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.536194 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.536345 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.536547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.536795 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.537044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.537044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.537404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.537558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.537717 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.537880 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538036 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538343 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538499 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538657 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.538814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.539643 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.539811 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.540043 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.540258 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.540418 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.540583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.540734 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.540734 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.541032 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.541182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.541330 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.541330 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.541634 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.541634 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.541934 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.542105 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.542263 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.542421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.542579 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.542727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.542883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.543097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.543264 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.543425 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.543575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.543725 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.543964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.544144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.544401 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.544556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.544714 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.544863 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.545066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.545221 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.545378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.545378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.545854 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.546169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.546449 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.546710 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.546985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.547218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.547374 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.547538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.547538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.547844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.548001 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.548150 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.548330 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.548572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.548838 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.549110 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.549367 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.549630 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.549835 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.549998 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.550193 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.550391 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.550546 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.550695 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.550843 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.551138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.551400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.551666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.551916 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.552155 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.552557 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.552792 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.553035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.553267 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.553492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.553721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.553963 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.554199 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.554620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.554902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.554902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.555420 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.555692 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.555692 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.557289 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.557558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.557800 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.558038 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.558266 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.558502 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.558738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.558962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.559267 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.559481 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.559651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.559820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.559820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.560117 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.560327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.560501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.560689 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.560689 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.560990 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.561149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.561307 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.561457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.561618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.561793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.561959 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.562110 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.562258 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.562406 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.562406 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.562701 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.562859 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.563026 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.563183 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.563183 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.563490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.563640 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.563820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.563977 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.563977 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.564270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.564418 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.564578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.564899 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.564899 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.565352 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.565530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.565530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.565831 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.565989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.566163 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.566312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.566312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.566602 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.566762 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.566762 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.567064 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.567220 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.567369 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.567529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.567529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.567823 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.567981 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.567981 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.568275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.568437 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.568588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.568737 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.568737 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.569067 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.569227 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.569386 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.569544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.569544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.569836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.570236 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.570390 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.570609 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.570609 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.571262 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.571351 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.571450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.571574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.571717 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.571824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.572602 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.572705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.572782 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.572861 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.572987 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573082 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573229 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573301 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573390 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573465 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573632 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.573859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574019 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574108 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574203 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574477 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574563 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574737 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574848 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.574989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575683 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575821 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.575821 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576082 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576082 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576769 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.576954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577107 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577205 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.577925 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578012 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578282 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578369 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578600 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578727 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578817 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.578902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579235 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579596 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579596 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579767 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579850 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.579934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580026 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580313 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580461 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580819 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.580916 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.581002 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.581176 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.581314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.581453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.581453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.581698 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.581825 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.581952 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582607 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582769 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582854 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582935 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.582935 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583099 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583174 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583409 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583489 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583697 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583783 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583783 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.583928 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584001 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584246 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584717 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584800 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.584977 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585068 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585162 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585331 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585579 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585718 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585718 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.585975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.586139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.586238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.586355 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.586467 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.586635 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.586761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.586874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587107 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587425 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587524 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587524 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587711 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.587968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588062 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588427 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588795 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.588947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589032 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589446 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589524 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589596 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589676 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589762 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589853 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.589947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590033 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590117 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590213 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590299 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590384 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590631 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590723 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.590910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591016 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591203 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591299 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591395 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591648 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591892 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.591985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592077 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592170 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592262 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592362 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592623 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592791 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592874 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592982 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.592982 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.593205 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.593316 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.593441 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.593598 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.593718 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.593816 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.593904 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594185 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594393 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594489 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594572 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594653 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594728 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594814 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594814 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.594961 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595308 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595392 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595392 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595531 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595689 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.595981 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596196 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596269 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596347 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596433 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596507 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596586 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596814 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.596959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597030 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597101 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597524 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.597890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598024 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598209 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598302 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598429 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598429 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598580 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598653 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598725 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598804 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.598971 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599077 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599501 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599581 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599654 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599725 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599805 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.599962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600041 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600041 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600405 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.600742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601006 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601421 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601421 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601938 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.601938 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602233 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602315 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602396 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602555 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602910 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.602987 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603316 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603473 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603546 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603617 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603917 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.603991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604072 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604232 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604311 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604393 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604813 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.604981 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605062 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605134 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605205 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605205 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605344 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605426 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605498 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605570 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605794 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605866 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.605937 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606008 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606078 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606399 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606624 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.606985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607786 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607865 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.607945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608025 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608025 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608395 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608474 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608630 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608701 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.608917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609316 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609405 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609714 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.609956 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610048 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610271 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610350 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610516 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610597 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610711 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.610857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.611220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.611311 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.611422 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.611569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.611569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.611804 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.611897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.611979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612482 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612482 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.612830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613214 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613377 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613377 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613520 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613735 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613815 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.613972 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614114 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614332 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614410 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614563 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614563 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614706 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614851 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.614922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615172 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615252 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615863 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.615937 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616018 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616642 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616642 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.616923 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617061 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617376 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617689 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617779 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617886 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.617986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618097 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618173 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618396 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618555 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618628 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618714 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618787 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618787 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618915 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.618995 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619233 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619308 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619472 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619545 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619616 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619687 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.619931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620024 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620286 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620550 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620641 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620726 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620811 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620908 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.620998 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.621199 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.621345 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.621345 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.621709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.621901 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.622073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.622230 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.622500 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.622622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.622720 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.622817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.622912 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.622999 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623103 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623367 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623367 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623632 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623632 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.623887 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.624020 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.624177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.624177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.624535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.624719 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.624889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625056 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625056 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625353 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625546 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625640 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625726 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625817 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.625910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626006 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626099 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626281 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.626903 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.627090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.627090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.627383 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.627545 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.627693 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.627843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.627989 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.628129 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.628270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.628427 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.628639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.628830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.628830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.629100 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.629354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.629354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.629646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.629794 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.629935 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.630077 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.630231 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.630375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.630375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.630648 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.630788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.630947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.631140 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.631140 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.631468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.631629 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.631770 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.631915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.632071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.632206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.632352 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.632495 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.632629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.632781 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.632961 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.633105 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.633273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.633273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.633552 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.633696 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.633839 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.633982 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.634130 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.634243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.634405 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.634631 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.634781 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.634872 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.634947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635098 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635425 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635505 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635670 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635670 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.635960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636191 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636455 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.636965 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637052 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637154 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637754 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.637933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.638019 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.638112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.638211 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.638336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.638493 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.638619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.638808 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.638966 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.639147 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.639244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.639465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.639576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.639793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.640121 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.640631 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.640835 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.641165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.641254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.641501 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.641597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.641857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.641940 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.642176 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.642265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.642513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.642601 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.642822 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.642904 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.643241 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.643363 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.643495 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.643608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.643778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.643920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.644053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=144777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:54:57.644384 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.644900 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.645398 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.645972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.646319 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.646652 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.646964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.647426 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.647738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.648050 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.649327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.649327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.649327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.649733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.649930 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.650256 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.650563 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.650866 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.651808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.651808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.651808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.652058 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.652354 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.652865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.653431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.653972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.654287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.654589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.654892 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.655285 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.655838 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.656395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.656784 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.657120 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.657435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.657996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.658523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.659069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.659586 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.660121 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.660663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.661197 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.661719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.662285 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.662815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.663372 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.663877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.664497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.664950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.665472 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.666042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.666424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.666745 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.667110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.667442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.667972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.668541 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.668978 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.669321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.669643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.669957 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.670273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.670587 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.670901 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.671246 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.671560 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.671873 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.672190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.672503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.672830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.673268 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.673577 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.674008 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.674232 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.675392 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.675392 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.676062 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.676400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.676720 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.677047 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.677817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:54:57.677942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=144776) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:54:57.717705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO dbcounter [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Registered counter for database nova_api Aug 30 00:54:57.744619 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_db.sqlalchemy.engines [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:54:57.752107 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writer thread running {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:54:57.752859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO dbcounter [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Registered counter for database nova_api Aug 30 00:54:57.780687 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:54:57.787972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writer thread running {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:54:57.811716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.context [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a8879ab-9ba0-40de-b078-fe33ec09ccfb(cell1) {{(pid=144777) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 00:54:57.815985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:54:57.816471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:54:57.818098 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:54:57.818852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:54:57.819329 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:54:57.821917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:54:57.824199 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO dbcounter [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Registered counter for database nova_cell0 Aug 30 00:54:57.828822 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO dbcounter [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Registered counter for database nova_cell1 Aug 30 00:54:57.838375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_db.sqlalchemy.engines [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:54:57.839668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_db.sqlalchemy.engines [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:54:57.847287 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writer thread running {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:54:57.848598 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writer thread running {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:54:57.856794 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.context [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7a8879ab-9ba0-40de-b078-fe33ec09ccfb(cell1) {{(pid=144776) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 00:54:57.861053 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:54:57.861530 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:54:57.863200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:54:57.863946 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:54:57.864395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:54:57.866689 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:54:57.869525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO dbcounter [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Registered counter for database nova_cell0 Aug 30 00:54:57.873376 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO dbcounter [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Registered counter for database nova_cell1 Aug 30 00:54:57.880828 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:54:57.886182 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writer thread running {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:54:58.005896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO dbcounter [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Registered counter for database nova_cell0 Aug 30 00:54:58.013911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_db.sqlalchemy.engines [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:54:58.019511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writer thread running {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:54:58.060236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:54:58.067737 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writer thread running {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:54:58.077990 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO dbcounter [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Registered counter for database nova_cell0 Aug 30 00:54:58.085667 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_db.sqlalchemy.engines [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144776) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:54:58.091364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writer thread running {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:54:58.349793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: WARNING keystonemiddleware.auth_token [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:54:58.357304 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: WARNING keystonemiddleware.auth_token [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:54:58.424481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: WARNING keystonemiddleware.auth_token [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:54:58.432241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: WARNING keystonemiddleware.auth_token [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:54:58.707982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: WARNING keystonemiddleware.auth_token [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:54:58.714403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: WARNING keystonemiddleware.auth_token [None req-209db201-29b1-4250-ab1b-5a1c4ed7c249 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:54:58.719839 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d3e4f999c0 pid: 144777 (default app) Aug 30 00:54:58.785873 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: WARNING keystonemiddleware.auth_token [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 00:54:58.792238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: WARNING keystonemiddleware.auth_token [None req-2c3ba105-e392-4d2d-8d88-13057069dc7d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 00:54:58.797635 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d3e4f999c0 pid: 144776 (default app) Aug 30 00:55:35.617399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.622194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.624572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.626692 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.679922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.684187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.685284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:35.686486 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:55:36.900482 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-277c17ab-9540-4c53-a856-a3766e5e75ea tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] Action: 'create', calling method: .version_select at 0x7f03a2fbbee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1998840381", "metadata": {"Type": "work"}}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:36.920172 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8563e8a4-c30a-4d97-bcd0-9c236499475f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Action: 'create', calling method: .version_select at 0x7f03a2fbce50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1653451911"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:38.681226 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8563e8a4-c30a-4d97-bcd0-9c236499475f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.014480 Aug 30 00:55:38.692433 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Aug 30 00:55:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3027 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 00:55:38.805724 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-277c17ab-9540-4c53-a856-a3766e5e75ea tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.205451 Aug 30 00:55:38.806344 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 1/2] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 30 00:55:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3208 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 00:55:38.812593 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9fed433b-da63-46f1-9460-37ef8cfb132a tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2e35d30>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:38.871606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9c7af671-b2fc-47d9-9665-3fdc049e36da tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Action: 'create', calling method: .version_select at 0x7f03a2e40c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1421281462", "metadata": {"Type": "work"}}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9c7af671-b2fc-47d9-9665-3fdc049e36da tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Request method failure captured: Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 122 Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAHAIszXRkDlBa6nkb7MDmnP9Z_EYzahAT_YW-bxnqj7i2B6tq6pVnjpnZQLLgV7flUl2dSCLfvV8Gb0Eu7Jx0_ZmJ04XfLDW1y3Y_UjixA_oKJhFK9Frd0dPZl1Z2hMVcPYndRv3BYRToDPYRIcs4fzN9ilmUxNoBIBHE3pKC4B68 Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 00:55:38.878995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8809a2a9708d415f996c33fc88edcd82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}] Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 0dfe54df1c2b45f3aba25b8340b60797 Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1421281462", "metadata": {"Type": "work"}}} Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: Aug 30 00:55:38.880588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1421281462', 'metadata': {'Type': 'work'}}}} Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise error Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:38.881523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 00:55:38.883619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 00:55:38.885608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 00:55:38.885608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.887036 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9c7af671-b2fc-47d9-9665-3fdc049e36da tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:38.888381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9c7af671-b2fc-47d9-9665-3fdc049e36da tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.194821 Aug 30 00:55:38.889453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 30 00:55:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:55:38.896649 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-46068741-eb8d-460b-9fb5-c81542f5cc76 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] Calling method '.version_select at 0x7f03a2e0e670>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:38.915611 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9fed433b-da63-46f1-9460-37ef8cfb132a tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2" status: 200 len: 345 microversion: 2.1 time: 0.106795 Aug 30 00:55:38.922893 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:38 2022] GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:38.928877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8d8e9d13-a599-46cd-a0fa-216101ad344f tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Action: 'create', calling method: .version_select at 0x7f03a2e56430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1028252377", "metadata": {"Type": "work"}}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8d8e9d13-a599-46cd-a0fa-216101ad344f tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Request method failure captured: Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 120 Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAHAIszXRkDlBa6nkb7MDmnP9Z_EYzahAT_YW-bxnqj7i2B6tq6pVnjpnZQLLgV7flUl2dSCLfvV8Gb0Eu7Jx0_ZmJ04XfLDW1y3Y_UjixA_oKJhFK9Frd0dPZl1Z2hMVcPYndRv3BYRToDPYRIcs4fzN9ilmUxNoBIBHE3pKC4B68 Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:55:38.937797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8809a2a9708d415f996c33fc88edcd82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}] Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 0dfe54df1c2b45f3aba25b8340b60797 Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1028252377", "metadata": {"Type": "work"}}} Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: Aug 30 00:55:38.939325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1028252377', 'metadata': {'Type': 'work'}}}} Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise error Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi '0' Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:38.940499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 00:55:38.942018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 00:55:38.943381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 00:55:38.943381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.943381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8d8e9d13-a599-46cd-a0fa-216101ad344f tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:38.943381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8d8e9d13-a599-46cd-a0fa-216101ad344f tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015319 Aug 30 00:55:38.943381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 3/5] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 30 00:55:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:55:38.954697 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7e62d2b9-1f21-4283-8476-5a8a270b05c3 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Action: 'create', calling method: .version_select at 0x7f03a37c9280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-888254736", "metadata": {"Type": "work"}}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7e62d2b9-1f21-4283-8476-5a8a270b05c3 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Request method failure captured: Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 118 Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAHAIszXRkDlBa6nkb7MDmnP9Z_EYzahAT_YW-bxnqj7i2B6tq6pVnjpnZQLLgV7flUl2dSCLfvV8Gb0Eu7Jx0_ZmJ04XfLDW1y3Y_UjixA_oKJhFK9Frd0dPZl1Z2hMVcPYndRv3BYRToDPYRIcs4fzN9ilmUxNoBIBHE3pKC4B68 Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:55:38.962018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8809a2a9708d415f996c33fc88edcd82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}] Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 0dfe54df1c2b45f3aba25b8340b60797 Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-888254736", "metadata": {"Type": "work"}}} Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: Aug 30 00:55:38.963562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-888254736', 'metadata': {'Type': 'work'}}}} Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise error Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi '' Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:38.964376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 00:55:38.965768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 00:55:38.967282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 00:55:38.967282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:38.967282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7e62d2b9-1f21-4283-8476-5a8a270b05c3 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:38.967282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7e62d2b9-1f21-4283-8476-5a8a270b05c3 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018046 Aug 30 00:55:38.967282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 4/6] 10.222.0.17 () {60 vars in 1156 bytes} [Tue Aug 30 00:55:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 00:55:38.992382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8a4d91b7-b969-4911-8b43-a20e0a51de9d tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Calling method '.version_select at 0x7f03a2e35ca0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:39.077459 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-46068741-eb8d-460b-9fb5-c81542f5cc76 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e" status: 200 len: 353 microversion: 2.1 time: 0.186685 Aug 30 00:55:39.078712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 3/7] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:38 2022] GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:39.138362 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-8a4d91b7-b969-4911-8b43-a20e0a51de9d tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] HTTP exception thrown: Volume tempest-invalid-1507116215 could not be found. Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8a4d91b7-b969-4911-8b43-a20e0a51de9d tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Request method failure captured: Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1507116215 HTTP/1.1 Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAHAIszXRkDlBa6nkb7MDmnP9Z_EYzahAT_YW-bxnqj7i2B6tq6pVnjpnZQLLgV7flUl2dSCLfvV8Gb0Eu7Jx0_ZmJ04XfLDW1y3Y_UjixA_oKJhFK9Frd0dPZl1Z2hMVcPYndRv3BYRToDPYRIcs4fzN9ilmUxNoBIBHE3pKC4B68 Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:55:39.143388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8809a2a9708d415f996c33fc88edcd82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}] Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 0dfe54df1c2b45f3aba25b8340b60797 Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Volume tempest-invalid-1507116215 could not be found. Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': 'tempest-invalid-1507116215'} Aug 30 00:55:39.144911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1507116215 could not be found. (HTTP 404) (Request-ID: req-de1dbb35-254f-46a6-bcb1-76222cd624c8) Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.145909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:55:39.147364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1507116215 could not be found. Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:39.148622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1507116215 could not be found. Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1507116215 could not be found. Aug 30 00:55:39.150186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.152548 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8a4d91b7-b969-4911-8b43-a20e0a51de9d tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Returning 404 to user: Volume tempest-invalid-1507116215 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:39.153570 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8a4d91b7-b969-4911-8b43-a20e0a51de9d tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1507116215" status: 404 len: 99 microversion: 2.1 time: 0.182366 Aug 30 00:55:39.154279 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 5/8] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 30 00:55:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1507116215 => generated 99 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 00:55:39.165484 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a8a011a7-7ab4-4438-996a-0649a79aeef4 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005480 Aug 30 00:55:39.166489 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 4/9] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Aug 30 00:55:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 00:55:39.178468 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7353e4ef-5624-427c-a933-284883282ae2 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005864 Aug 30 00:55:39.182314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 6/10] 10.222.0.17 () {58 vars in 1137 bytes} [Tue Aug 30 00:55:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 00:55:39.192186 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b1cb2306-5214-4871-9b8f-afcee7691785 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Calling method '.version_select at 0x7f03a2e54040>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:39.269920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-b1cb2306-5214-4871-9b8f-afcee7691785 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] HTTP exception thrown: Volume 759b9952-0fe7-479f-a72b-b6e2a9f07a1f could not be found. Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b1cb2306-5214-4871-9b8f-afcee7691785 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Request method failure captured: Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: DELETE /compute/v2.1/os-volumes/759b9952-0fe7-479f-a72b-b6e2a9f07a1f HTTP/1.1 Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAHAIszXRkDlBa6nkb7MDmnP9Z_EYzahAT_YW-bxnqj7i2B6tq6pVnjpnZQLLgV7flUl2dSCLfvV8Gb0Eu7Jx0_ZmJ04XfLDW1y3Y_UjixA_oKJhFK9Frd0dPZl1Z2hMVcPYndRv3BYRToDPYRIcs4fzN9ilmUxNoBIBHE3pKC4B68 Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 00:55:39.274470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8809a2a9708d415f996c33fc88edcd82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}] Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 0dfe54df1c2b45f3aba25b8340b60797 Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Volume 759b9952-0fe7-479f-a72b-b6e2a9f07a1f could not be found. Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '759b9952-0fe7-479f-a72b-b6e2a9f07a1f'} Aug 30 00:55:39.275920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 759b9952-0fe7-479f-a72b-b6e2a9f07a1f could not be found. (HTTP 404) (Request-ID: req-08e74e85-edc3-4540-810f-2301b875fea9) Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.280918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:55:39.282427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 759b9952-0fe7-479f-a72b-b6e2a9f07a1f could not be found. Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 00:55:39.283778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 759b9952-0fe7-479f-a72b-b6e2a9f07a1f could not be found. Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 759b9952-0fe7-479f-a72b-b6e2a9f07a1f could not be found. Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b1cb2306-5214-4871-9b8f-afcee7691785 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Returning 404 to user: Volume 759b9952-0fe7-479f-a72b-b6e2a9f07a1f could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b1cb2306-5214-4871-9b8f-afcee7691785 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/759b9952-0fe7-479f-a72b-b6e2a9f07a1f" status: 404 len: 109 microversion: 2.1 time: 0.088380 Aug 30 00:55:39.285627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 5/11] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 00:55:39 2022] DELETE /compute/v2.1/os-volumes/759b9952-0fe7-479f-a72b-b6e2a9f07a1f => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:55:39.288007 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2616da7e-2e64-4356-b706-4417860af320 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Calling method '.version_select at 0x7f03a2ddcb80>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:39.351538 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-2616da7e-2e64-4356-b706-4417860af320 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] HTTP exception thrown: Volume f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe could not be found. Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2616da7e-2e64-4356-b706-4417860af320 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Request method failure captured: Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/os-volumes/f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe HTTP/1.1 Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAHAIszXRkDlBa6nkb7MDmnP9Z_EYzahAT_YW-bxnqj7i2B6tq6pVnjpnZQLLgV7flUl2dSCLfvV8Gb0Eu7Jx0_ZmJ04XfLDW1y3Y_UjixA_oKJhFK9Frd0dPZl1Z2hMVcPYndRv3BYRToDPYRIcs4fzN9ilmUxNoBIBHE3pKC4B68 Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:55:39.355174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8809a2a9708d415f996c33fc88edcd82", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8809a2a9708d415f996c33fc88edcd82"}]}] Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 8809a2a9708d415f996c33fc88edcd82 Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-VolumesNegativeTest-126038073 Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 0dfe54df1c2b45f3aba25b8340b60797 Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-VolumesNegativeTest-126038073-project Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Volume f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe could not be found. Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': 'f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe'} Aug 30 00:55:39.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe could not be found. (HTTP 404) (Request-ID: req-ad10d045-8466-4bb5-a9e0-96f06c29c3f8) Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.357475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:39.358696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe could not be found. Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 00:55:39.359829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe could not be found. Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe could not be found. Aug 30 00:55:39.361463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:39.364542 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2616da7e-2e64-4356-b706-4417860af320 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] Returning 404 to user: Volume f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:39.364542 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2616da7e-2e64-4356-b706-4417860af320 tempest-VolumesNegativeTest-126038073 tempest-VolumesNegativeTest-126038073-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe" status: 404 len: 109 microversion: 2.1 time: 0.080827 Aug 30 00:55:39.365456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 7/12] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:39 2022] GET /compute/v2.1/os-volumes/f0ee1407-a60d-47b1-b28d-8d4a6c2f9efe => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:55:39.931991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-44eaa6b8-18ce-49e2-b957-60ae655ddf41 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2e40f70>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:40.061083 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-44eaa6b8-18ce-49e2-b957-60ae655ddf41 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2" status: 200 len: 346 microversion: 2.1 time: 0.135178 Aug 30 00:55:40.061646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 6/13] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:39 2022] GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 => generated 346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:55:40.076139 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-55302b9f-1115-4dff-9a6d-ee22e275167f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Action: 'create', calling method: .version_select at 0x7f03a37c9310>, body: {"snapshot": {"volume_id": "66a3689d-b508-4b55-a39c-8b74c8a96aa2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-989360273"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:40.092563 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7f7503af-2882-4e9b-9e72-21acd299b542 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] Calling method '.version_select at 0x7f03a2e54700>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:40.238090 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7f7503af-2882-4e9b-9e72-21acd299b542 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e" status: 200 len: 354 microversion: 2.1 time: 0.150022 Aug 30 00:55:40.239591 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 7/14] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:40 2022] GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:40.251905 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d4141294-7a73-443d-bd18-25cd86eae812 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] Calling method '.version_select at 0x7f03a2d671f0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:40.346746 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d4141294-7a73-443d-bd18-25cd86eae812 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e" status: 200 len: 354 microversion: 2.1 time: 0.098514 Aug 30 00:55:40.359161 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 8/15] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:40 2022] GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:40.367216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-df14e92c-9852-4da7-bb3b-ead885e09615 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] Calling method '.version_select at 0x7f03a2d678b0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:40.489747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-df14e92c-9852-4da7-bb3b-ead885e09615 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e" status: 202 len: 0 microversion: 2.1 time: 0.127134 Aug 30 00:55:40.490531 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 9/16] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 00:55:40 2022] DELETE /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:55:40.500865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fade919c-834d-41f4-bd91-4b910cf72dc1 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] Calling method '.version_select at 0x7f03a2e54700>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:40.547536 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-55302b9f-1115-4dff-9a6d-ee22e275167f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.476454 Aug 30 00:55:40.548211 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 8/17] 10.222.0.17 () {60 vars in 1162 bytes} [Tue Aug 30 00:55:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:40.560676 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7b78ca4b-772d-4fa0-85c8-aeabb6bd0b25 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d678b0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:40.633751 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7b78ca4b-772d-4fa0-85c8-aeabb6bd0b25 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a" status: 200 len: 286 microversion: 2.1 time: 0.077262 Aug 30 00:55:40.635019 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 9/18] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 30 00:55:40 2022] GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:40.646387 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-708c2d0c-287c-4ff9-8f15-8666c2263bd1 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d67ee0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:40.991784 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-fade919c-834d-41f4-bd91-4b910cf72dc1 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] HTTP exception thrown: Volume 7084f083-fb4c-4b44-bb02-77c854956a3e could not be found. Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fade919c-834d-41f4-bd91-4b910cf72dc1 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] Request method failure captured: Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e HTTP/1.1 Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAHDzdAJMyZeH_etaE1OFeDqtsqqeTrdXsjWp3RzGBuYEuxoHLvik6-ZWC09vHQzSR-QcWlYbyAEJwQFCL54sFgA3Ak7sabS6fLrdLcP9u5h7s3XRxEoK5iXIGbcMVAvRtVLhhOdZg1qRmwTtOLr7JbbFg1cyMSfBsamkyqJS8t7Hg Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 1da2a1cc47754a40a0ebf71905bb43ed Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesGetTestJSON-1786213312 Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 00:55:40.993731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1da2a1cc47754a40a0ebf71905bb43ed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1da2a1cc47754a40a0ebf71905bb43ed", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1da2a1cc47754a40a0ebf71905bb43ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1da2a1cc47754a40a0ebf71905bb43ed"}]}] Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesGetTestJSON-1786213312 Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 1da2a1cc47754a40a0ebf71905bb43ed Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesGetTestJSON-1786213312 Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesGetTestJSON-1786213312-project Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: b238cd707f7c4da0958c9a48f2fd947a Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesGetTestJSON-1786213312-project Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Volume 7084f083-fb4c-4b44-bb02-77c854956a3e could not be found. Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '7084f083-fb4c-4b44-bb02-77c854956a3e'} Aug 30 00:55:40.994875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7084f083-fb4c-4b44-bb02-77c854956a3e could not be found. (HTTP 404) (Request-ID: req-db93bdfd-b3c8-4b0c-8727-bb270f71eba5) Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:40.995638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:40.996890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7084f083-fb4c-4b44-bb02-77c854956a3e could not be found. Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 00:55:40.997846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7084f083-fb4c-4b44-bb02-77c854956a3e could not be found. Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7084f083-fb4c-4b44-bb02-77c854956a3e could not be found. Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:40.998780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fade919c-834d-41f4-bd91-4b910cf72dc1 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] Returning 404 to user: Volume 7084f083-fb4c-4b44-bb02-77c854956a3e could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:41.002147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fade919c-834d-41f4-bd91-4b910cf72dc1 tempest-VolumesGetTestJSON-1786213312 tempest-VolumesGetTestJSON-1786213312-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e" status: 404 len: 109 microversion: 2.1 time: 0.500420 Aug 30 00:55:41.004220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 10/19] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:40 2022] GET /compute/v2.1/os-volumes/7084f083-fb4c-4b44-bb02-77c854956a3e => generated 109 bytes in 510 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:55:41.150723 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-708c2d0c-287c-4ff9-8f15-8666c2263bd1 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.508712 Aug 30 00:55:41.162120 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 10/20] 10.222.0.17 () {58 vars in 1140 bytes} [Tue Aug 30 00:55:40 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:41.174395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-de92b2d4-b3e9-474e-a2c7-d911a7c34189 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d67c10>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:41.384759 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-de92b2d4-b3e9-474e-a2c7-d911a7c34189 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a" status: 200 len: 286 microversion: 2.1 time: 0.214497 Aug 30 00:55:41.385936 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 11/21] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 30 00:55:41 2022] GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a => generated 286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:42.399581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-19c3e3e3-a563-4b27-8e27-438f9d6b8fad tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d741f0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:42.506726 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-19c3e3e3-a563-4b27-8e27-438f9d6b8fad tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a" status: 200 len: 286 microversion: 2.1 time: 0.112565 Aug 30 00:55:42.508185 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 11/22] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 30 00:55:42 2022] GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a => generated 286 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:43.522206 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cdafa38b-4396-4e00-aa13-da01a14ca866 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a37ca1f0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:43.582265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cdafa38b-4396-4e00-aa13-da01a14ca866 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a" status: 200 len: 286 microversion: 2.1 time: 0.065686 Aug 30 00:55:43.582831 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 12/23] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 30 00:55:43 2022] GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:55:44.597901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-75a5165a-ca51-4311-83e9-607cce481d3d tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d6b790>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:44.674362 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-75a5165a-ca51-4311-83e9-607cce481d3d tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a" status: 200 len: 287 microversion: 2.1 time: 0.082368 Aug 30 00:55:44.675603 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 12/24] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 30 00:55:44 2022] GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:44.687964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ccca40ba-9849-410e-aa1e-f84ca3a77db8 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2e543a0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:44.848632 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ccca40ba-9849-410e-aa1e-f84ca3a77db8 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a" status: 202 len: 0 microversion: 2.1 time: 0.165143 Aug 30 00:55:44.849608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Aug 30 00:55:44 2022] DELETE /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:55:44.858053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-070e2e0f-da66-4ce6-84eb-6112344dea6e tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d6b040>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:44.929993 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-070e2e0f-da66-4ce6-84eb-6112344dea6e tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a" status: 200 len: 286 microversion: 2.1 time: 0.075934 Aug 30 00:55:44.930992 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 30 00:55:44 2022] GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:45.944146 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-144e47d9-c1e1-4283-88dc-b1c54baa654d tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d67af0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:46.012761 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-144e47d9-c1e1-4283-88dc-b1c54baa654d tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] HTTP exception thrown: Snapshot 46bf7dab-a058-4186-a841-fd386d73c64a could not be found. Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-144e47d9-c1e1-4283-88dc-b1c54baa654d tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Request method failure captured: Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a HTTP/1.1 Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAHJyLK6fhdIoOAuoHGc-J5zdCtE4tYfj82q4Ngenlr_cFqDxlGouWIp8_hOR_a7s_lZruhaggKQu4NMEmcr3C4GiQrLNQ8ak3uXdHfWf43gDAYJ_aOSLmcmymKffWp0tdGNR7BpnJTAmnEM5JxTpr3nVqClO7H8PQs5Zkl6ZKxlYQ Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: bd5812ff7859449882b0e82e3b9bb38f Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 00:55:46.015817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bd5812ff7859449882b0e82e3b9bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bd5812ff7859449882b0e82e3b9bb38f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd5812ff7859449882b0e82e3b9bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd5812ff7859449882b0e82e3b9bb38f"}]}] Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: bd5812ff7859449882b0e82e3b9bb38f Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesSnapshotsTestJSON-1029385769-project Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 4743224ed4eb406aab59e018d69a3116 Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1029385769-project Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Snapshot 46bf7dab-a058-4186-a841-fd386d73c64a could not be found. Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '46bf7dab-a058-4186-a841-fd386d73c64a'} Aug 30 00:55:46.016907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 46bf7dab-a058-4186-a841-fd386d73c64a could not be found. (HTTP 404) (Request-ID: req-56569939-e8f4-4cdf-80a4-d60d7a4d8bff) Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:46.017547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:46.018408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 46bf7dab-a058-4186-a841-fd386d73c64a could not be found. Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 00:55:46.019340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 46bf7dab-a058-4186-a841-fd386d73c64a could not be found. Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 46bf7dab-a058-4186-a841-fd386d73c64a could not be found. Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-144e47d9-c1e1-4283-88dc-b1c54baa654d tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Returning 404 to user: Snapshot 46bf7dab-a058-4186-a841-fd386d73c64a could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:46.020456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-144e47d9-c1e1-4283-88dc-b1c54baa654d tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a" status: 404 len: 111 microversion: 2.1 time: 0.077911 Aug 30 00:55:46.021065 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 14/27] 10.222.0.17 () {58 vars in 1251 bytes} [Tue Aug 30 00:55:45 2022] GET /compute/v2.1/os-snapshots/46bf7dab-a058-4186-a841-fd386d73c64a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:55:46.026596 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b24122cb-326e-4b84-8074-f3ffc2d80add tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d67dc0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:46.188756 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b24122cb-326e-4b84-8074-f3ffc2d80add tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2" status: 202 len: 0 microversion: 2.1 time: 0.166393 Aug 30 00:55:46.190143 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 14/28] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 00:55:46 2022] DELETE /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:55:46.199598 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e856d408-6047-4de2-9338-affa1a54af4b tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2e40b80>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:46.300594 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e856d408-6047-4de2-9338-affa1a54af4b tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2" status: 200 len: 345 microversion: 2.1 time: 0.106426 Aug 30 00:55:46.311259 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 15/29] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:46 2022] GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:47.321575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-775fe1a7-107e-4337-b2fb-88eb55e8c24f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d67820>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:47.405915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-775fe1a7-107e-4337-b2fb-88eb55e8c24f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] HTTP exception thrown: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-775fe1a7-107e-4337-b2fb-88eb55e8c24f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Request method failure captured: Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 HTTP/1.1 Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAHJyLK6fhdIoOAuoHGc-J5zdCtE4tYfj82q4Ngenlr_cFqDxlGouWIp8_hOR_a7s_lZruhaggKQu4NMEmcr3C4GiQrLNQ8ak3uXdHfWf43gDAYJ_aOSLmcmymKffWp0tdGNR7BpnJTAmnEM5JxTpr3nVqClO7H8PQs5Zkl6ZKxlYQ Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: bd5812ff7859449882b0e82e3b9bb38f Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:55:47.408050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bd5812ff7859449882b0e82e3b9bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bd5812ff7859449882b0e82e3b9bb38f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd5812ff7859449882b0e82e3b9bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd5812ff7859449882b0e82e3b9bb38f"}]}] Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: bd5812ff7859449882b0e82e3b9bb38f Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-VolumesSnapshotsTestJSON-1029385769-project Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 4743224ed4eb406aab59e018d69a3116 Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1029385769-project Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '66a3689d-b508-4b55-a39c-8b74c8a96aa2'} Aug 30 00:55:47.409100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. (HTTP 404) (Request-ID: req-dc09674a-3bad-4912-b284-48bea1aa6674) Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.409727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:47.410604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 00:55:47.411547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-775fe1a7-107e-4337-b2fb-88eb55e8c24f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Returning 404 to user: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-775fe1a7-107e-4337-b2fb-88eb55e8c24f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2" status: 404 len: 109 microversion: 2.1 time: 0.095589 Aug 30 00:55:47.412620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 15/30] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:47 2022] GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:55:47.427166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ccb67bfa-3c0c-4f2b-bf21-17d988599587 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d67ca0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:47.468774 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-ccb67bfa-3c0c-4f2b-bf21-17d988599587 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] HTTP exception thrown: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ccb67bfa-3c0c-4f2b-bf21-17d988599587 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Request method failure captured: Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: DELETE /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 HTTP/1.1 Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAHJyLK6fhdIoOAuoHGc-J5zdCtE4tYfj82q4Ngenlr_cFqDxlGouWIp8_hOR_a7s_lZruhaggKQu4NMEmcr3C4GiQrLNQ8ak3uXdHfWf43gDAYJ_aOSLmcmymKffWp0tdGNR7BpnJTAmnEM5JxTpr3nVqClO7H8PQs5Zkl6ZKxlYQ Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: bd5812ff7859449882b0e82e3b9bb38f Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 00:55:47.470891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bd5812ff7859449882b0e82e3b9bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bd5812ff7859449882b0e82e3b9bb38f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd5812ff7859449882b0e82e3b9bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd5812ff7859449882b0e82e3b9bb38f"}]}] Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: bd5812ff7859449882b0e82e3b9bb38f Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesSnapshotsTestJSON-1029385769-project Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 4743224ed4eb406aab59e018d69a3116 Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1029385769-project Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '66a3689d-b508-4b55-a39c-8b74c8a96aa2'} Aug 30 00:55:47.472223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. (HTTP 404) (Request-ID: req-53e8aa7d-edf0-4c62-a01f-b1313b9e8df2) Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.472984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 00:55:47.474558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 00:55:47.475894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ccb67bfa-3c0c-4f2b-bf21-17d988599587 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Returning 404 to user: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ccb67bfa-3c0c-4f2b-bf21-17d988599587 tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2" status: 404 len: 109 microversion: 2.1 time: 0.052125 Aug 30 00:55:47.477854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 16/31] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 00:55:47 2022] DELETE /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:55:47.483413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-380f3deb-4d31-48f5-ba38-7ea79581777f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Calling method '.version_select at 0x7f03a2d67dc0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:47.524375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-380f3deb-4d31-48f5-ba38-7ea79581777f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] HTTP exception thrown: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-380f3deb-4d31-48f5-ba38-7ea79581777f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Request method failure captured: Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 HTTP/1.1 Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAHJyLK6fhdIoOAuoHGc-J5zdCtE4tYfj82q4Ngenlr_cFqDxlGouWIp8_hOR_a7s_lZruhaggKQu4NMEmcr3C4GiQrLNQ8ak3uXdHfWf43gDAYJ_aOSLmcmymKffWp0tdGNR7BpnJTAmnEM5JxTpr3nVqClO7H8PQs5Zkl6ZKxlYQ Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: bd5812ff7859449882b0e82e3b9bb38f Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:55:47.526584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bd5812ff7859449882b0e82e3b9bb38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bd5812ff7859449882b0e82e3b9bb38f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd5812ff7859449882b0e82e3b9bb38f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bd5812ff7859449882b0e82e3b9bb38f"}]}] Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: bd5812ff7859449882b0e82e3b9bb38f Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1029385769 Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-VolumesSnapshotsTestJSON-1029385769-project Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 4743224ed4eb406aab59e018d69a3116 Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1029385769-project Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '66a3689d-b508-4b55-a39c-8b74c8a96aa2'} Aug 30 00:55:47.527735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. (HTTP 404) (Request-ID: req-60f7c609-feb9-4114-b588-dc2b38d02ab8) Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.528366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 00:55:47.530201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 00:55:47.531091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-380f3deb-4d31-48f5-ba38-7ea79581777f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] Returning 404 to user: Volume 66a3689d-b508-4b55-a39c-8b74c8a96aa2 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-380f3deb-4d31-48f5-ba38-7ea79581777f tempest-VolumesSnapshotsTestJSON-1029385769 tempest-VolumesSnapshotsTestJSON-1029385769-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2" status: 404 len: 109 microversion: 2.1 time: 0.049432 Aug 30 00:55:47.532466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 16/32] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 00:55:47 2022] GET /compute/v2.1/os-volumes/66a3689d-b508-4b55-a39c-8b74c8a96aa2 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:55:48.172208 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cf39b324-214a-4c8f-957c-ef53fb25f842 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'create', calling method: .version_select at 0x7f03a2e40b80>, body: {"keypair": {"name": "tempest-keypair-422795611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo0gNcTNulMWQlzfgQWsw3bVTw3tC4lFbUY2vk/H3oK+aM5WRZiacOowj83D54p56AlRo67ZoRk8MWZprp7zkDRjt5+qc4EAMmVP4m74kOJPYXwrsxnFA+uNDOQBfKASA=="}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:48.302757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-cf39b324-214a-4c8f-957c-ef53fb25f842 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Getting quotas for project e36d98f444ec4d12a1a55ef450de63a5. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:55:48.353636 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-cf39b324-214a-4c8f-957c-ef53fb25f842 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Getting quotas for user f2a8b56e48b445709054849f4893767a and project e36d98f444ec4d12a1a55ef450de63a5. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:55:48.539257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cf39b324-214a-4c8f-957c-ef53fb25f842 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.812282 Aug 30 00:55:48.540275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 17/33] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Aug 30 00:55:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 814 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 00:55:53.508156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-846070537", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "networks": [{"uuid": "a5133b66-75ed-45d1-86cb-feb443012044"}]}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:53.830962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] validate_networks() for [('a5133b66-75ed-45d1-86cb-feb443012044', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:55:55.114620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-966025300", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:55.427638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] validate_networks() for [('770e41c2-a4c2-40d0-a91c-277558a93ee6', None, None, None, None, None)] {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:55:56.571794 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:55:56.572951 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:55:56.573569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:55:56.574112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:55:56.574663 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:55:56.613479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:55:56.613962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:55:56.614404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:55:56.620819 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:55:56.623627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:55:56.628152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:55:56.726883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Getting quotas for project 1ab0b517d41b4b83af9af6f1fcce13d7. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:55:56.741837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Getting quotas for user e0e5c1345e4049f0bf5fc17ef71b7133 and project 1ab0b517d41b4b83af9af6f1fcce13d7. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:55:56.771144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:55:56.777075 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:55:56.977117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c2a5954f-249f-4976-91ea-6d932457eb24 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.956422 Aug 30 00:55:56.980103 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 17/34] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:55:57.004741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2077861112", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54dd3c3b-76a1-4705-8049-764d2291f7aa"}], "security_groups": [{"name": "tempest-securitygroup--578349153"}], "key_name": "tempest-keypair-422795611", "user_data": "}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:57.318837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] validate_networks() for [('54dd3c3b-76a1-4705-8049-764d2291f7aa', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:55:57.862719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:55:57.863228 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:55:57.863666 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:55:57.864085 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:55:57.864492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:55:57.889952 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:55:57.894842 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:55:57.895336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:55:57.916619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:55:57.916619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:55:57.916619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:55:58.000270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Getting quotas for project 9a1cf0a235aa4669a9276c293a78f2eb. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:55:58.009465 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Getting quotas for user 1d1c13089bd14d48ba637468182eee14 and project 9a1cf0a235aa4669a9276c293a78f2eb. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:55:58.057585 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:55:58.060894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:55:58.326739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-89ff5b2d-a2a2-4b8d-a758-aeec49a3b561 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.882474 Aug 30 00:55:58.329676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 18/35] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:55:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:55:58.349622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ac833c18-0774-4ee1-8e1e-c92be18a731c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:58.351508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ac833c18-0774-4ee1-8e1e-c92be18a731c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:55:58.568691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:55:58.571828 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:55:58.572677 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:55:58.573345 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:55:58.574031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:55:58.609211 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:55:58.610406 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:55:58.612778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:55:58.613838 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:55:58.620925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:55:58.621731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:55:58.671651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ac833c18-0774-4ee1-8e1e-c92be18a731c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:55:58.686317 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Getting quotas for project e36d98f444ec4d12a1a55ef450de63a5. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:55:58.697267 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Getting quotas for user f2a8b56e48b445709054849f4893767a and project e36d98f444ec4d12a1a55ef450de63a5. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:55:58.712430 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ac833c18-0774-4ee1-8e1e-c92be18a731c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1214 microversion: 2.1 time: 0.381049 Aug 30 00:55:58.713313 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 19/36] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:55:58 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1214 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:55:58.731545 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:55:58.739502 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:55:58.920782 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-70a6d16e-81fe-42d7-93ad-308d7964460d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.938955 Aug 30 00:55:58.921552 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 18/37] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Aug 30 00:55:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 00:55:58.946083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-547ea053-3f3f-44df-99f9-8d79a31eb3f1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:58.946989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-547ea053-3f3f-44df-99f9-8d79a31eb3f1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:55:59.559658 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-48b96746-f321-4dc7-975b-419fa2fb695c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'create', calling method: .version_select at 0x7f03a2c94310>, body: {"keypair": {"name": "tempest-keypair-561868308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkVdoKzvizSUeB+UH+Ou2ES8wxQkGdX/J9ixs9/PuZrzA77xRWtIbJCGOSxRCqbnM5ju5KqpwLXIRa1V7Y1smh+zyXAIFyrqmFVUDr+Yr0x9khNTbDPukXES2xQz8AD3Q=="}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:55:59.635107 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-48b96746-f321-4dc7-975b-419fa2fb695c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Getting quotas for project 7e919c196d074b8989b4719267ce24f8. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:55:59.659334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-48b96746-f321-4dc7-975b-419fa2fb695c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Getting quotas for user 22f11e29c4ad4712a54877b0895d28a4 and project 7e919c196d074b8989b4719267ce24f8. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:55:59.747729 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-48b96746-f321-4dc7-975b-419fa2fb695c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.015810 Aug 30 00:55:59.748440 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 20/38] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 00:55:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:55:59.758800 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-32c2458e-0b92-4c89-a2e1-00af0a652638 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:55:59.760743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-32c2458e-0b92-4c89-a2e1-00af0a652638 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:00.031650 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-547ea053-3f3f-44df-99f9-8d79a31eb3f1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:00.082134 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-547ea053-3f3f-44df-99f9-8d79a31eb3f1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1221 microversion: 2.1 time: 1.149473 Aug 30 00:56:00.084819 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 19/39] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:55:58 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1221 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:00.109841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-67fb8f5b-9358-42e4-b034-694d57d84d20 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:00.112033 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-67fb8f5b-9358-42e4-b034-694d57d84d20 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:00.263874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-32c2458e-0b92-4c89-a2e1-00af0a652638 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:00.272016 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-32c2458e-0b92-4c89-a2e1-00af0a652638 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:00.275449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-32c2458e-0b92-4c89-a2e1-00af0a652638 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:00.285710 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-32c2458e-0b92-4c89-a2e1-00af0a652638 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1281 microversion: 2.20 time: 0.535069 Aug 30 00:56:00.288387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:55:59 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1281 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:00.445533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-67fb8f5b-9358-42e4-b034-694d57d84d20 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:00.477380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-67fb8f5b-9358-42e4-b034-694d57d84d20 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1214 microversion: 2.1 time: 0.389971 Aug 30 00:56:00.478322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 20/41] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:00 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1214 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:00.552802 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-863555420", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:00.741618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] validate_networks() for [('770e41c2-a4c2-40d0-a91c-277558a93ee6', None, None, None, None, None)] {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:56:01.310411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:01.311778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:01.333339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:01.335852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:01.346845 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:01.347958 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:01.348550 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:01.349168 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:01.679318 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:01.700146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:01.711598 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:01.713201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4eb97d09-038a-456d-9f58-a514680f694f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1277 microversion: 2.20 time: 0.407092 Aug 30 00:56:01.728354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:01 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1277 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:56:01.735363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:01.735363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:01.747985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:01.747985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:01.747985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:01.751381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:01.751998 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:01.754272 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:02.010159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:02.024132 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-86ebb175-9622-4a60-9f79-0f0bcc611fb4 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1266 microversion: 2.1 time: 0.305181 Aug 30 00:56:02.039677 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 22/43] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:01 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:02.743547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:02.745194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:02.757175 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:02.758001 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:02.758586 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:02.762271 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:02.762898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:02.763901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:03.199608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:56:03.200430 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:56:03.201072 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:56:03.201544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:56:03.202099 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:56:03.236233 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:03.241941 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:03.242679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:03.243479 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:03.243945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:03.244369 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:03.293672 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Getting quotas for project 9a1cf0a235aa4669a9276c293a78f2eb. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:56:03.305708 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Getting quotas for user 1d1c13089bd14d48ba637468182eee14 and project 9a1cf0a235aa4669a9276c293a78f2eb. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:56:03.333706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:56:03.338469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:56:03.435514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:03.455902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:03.460637 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:03.464449 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9bb4dada-5a53-474e-a1b7-287fb117b2d0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1333 microversion: 2.20 time: 0.725398 Aug 30 00:56:03.466677 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:02 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1333 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:56:03.484229 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:03.484904 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-2c928491-d93f-449c-ba04-df8a38d81435 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.936565 Aug 30 00:56:03.485030 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:03.486477 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:56:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:56:03.505857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:03.509017 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:03.511301 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:03.512224 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:03.513511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:03.515739 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:03.516424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bf8e70b4-496d-4b3b-99f7-4750d8063d45 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:03.517987 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bf8e70b4-496d-4b3b-99f7-4750d8063d45 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:03.724775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bf8e70b4-496d-4b3b-99f7-4750d8063d45 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:03.735202 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bf8e70b4-496d-4b3b-99f7-4750d8063d45 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1221 microversion: 2.1 time: 0.237261 Aug 30 00:56:03.743495 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 23/46] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:03 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1221 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:03.815533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:03.829547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-09cd3996-a226-4ce7-94be-05296fa36097 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1272 microversion: 2.1 time: 0.358132 Aug 30 00:56:03.830156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 24/47] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:03 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1272 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:04.497269 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:04.497903 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:04.518155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:04.521256 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:04.524274 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:04.525284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:04.526799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:04.527508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:04.767207 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:04.767832 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:04.794096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:04.794871 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:04.798850 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:04.800801 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:04.803621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:04.806065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:05.892177 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:05.944837 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:05.958141 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:05.962418 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-348999ee-965e-4f34-ae8e-cfe74deddc23 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1339 microversion: 2.20 time: 1.468493 Aug 30 00:56:05.979387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 24/48] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:04 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1339 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:05.993188 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:05.993937 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:06.005044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:06.007023 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:06.010487 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:06.011357 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:06.011882 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:06.012331 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:06.041293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:06.055286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5594c4e6-96d1-40c7-af16-c7add291e4b5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1217 microversion: 2.1 time: 1.288985 Aug 30 00:56:06.058930 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 25/49] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:04 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1217 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:06.316181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:06.348349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e087265d-196b-40f2-b19a-02a0c0e927e2 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1272 microversion: 2.1 time: 0.350447 Aug 30 00:56:06.371551 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 25/50] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:05 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1272 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:06.985888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:06.986578 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:07.000002 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:07.000589 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:07.001004 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:07.001726 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:07.009770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:07.010456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:07.086098 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:07.086712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:07.103290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:07.103799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:07.104242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:07.104969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:07.107743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:07.108184 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:07.227319 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:07.239907 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:07.245021 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:07.248237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-067fee2f-5737-41c4-a32c-6044f73cb0e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1339 microversion: 2.20 time: 0.266476 Aug 30 00:56:07.251249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:06 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1339 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:07.281542 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1469206276", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46512a58-d3d5-4f03-89cc-6d31fd678fea"}], "security_groups": [{"name": "tempest-securitygroup--909521958"}], "key_name": "tempest-keypair-561868308", "user_data": "}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:07.319427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:07.329609 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c9cde197-460a-4475-aa3d-e4638cad30b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1279 microversion: 2.1 time: 0.247868 Aug 30 00:56:07.336570 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 26/52] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:07 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1279 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:07.376252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:07.377431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:07.404080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:07.404665 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:07.405463 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:07.407995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:07.408790 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:07.415605 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:07.663845 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:07.677983 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-491e9347-40d4-43fd-8715-cd2d25c1006b tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1272 microversion: 2.1 time: 0.305770 Aug 30 00:56:07.684423 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 27/53] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:07 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:07.703021 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] validate_networks() for [('46512a58-d3d5-4f03-89cc-6d31fd678fea', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:56:08.278545 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:08.279431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:08.311400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:08.312747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:08.313260 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:08.316246 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:08.317449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:08.332290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:08.589116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:08.600376 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:08.605625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:08.608319 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e733a530-e467-499d-9a3e-fae0a8c3f59e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1339 microversion: 2.20 time: 0.335948 Aug 30 00:56:08.610876 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 28/54] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:08 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1339 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:56:08.619055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:08.619979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:08.631071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:08.631987 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:08.632643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:08.633591 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:08.636455 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:08.638438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:08.658896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=4 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:08.851768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:08.871690 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bee0aeb1-72b5-4495-9069-e5c45746b245 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1279 microversion: 2.1 time: 0.247575 Aug 30 00:56:08.889369 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 29/55] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:08 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1279 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:08.896728 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:08.898372 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:08.912512 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:08.913736 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:08.914556 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:08.915574 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:08.916328 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:08.916959 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:09.911496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:56:09.911496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:56:09.911496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:56:09.911496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:56:09.911496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:56:09.922850 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:09.923864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:09.924522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:09.925578 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:09.926190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:09.926848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:09.969323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Getting quotas for project 7e919c196d074b8989b4719267ce24f8. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:56:09.980697 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Getting quotas for user 22f11e29c4ad4712a54877b0895d28a4 and project 7e919c196d074b8989b4719267ce24f8. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:56:10.023342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:56:10.028253 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:56:10.030661 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:10.048861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4679cdd7-bd4a-4411-a642-843cb1bcbbf6 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 1.155650 Aug 30 00:56:10.050662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 30/56] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:08 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:10.062938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:10.064611 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:10.085286 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:10.086154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:10.088499 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:10.089700 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:10.094182 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:10.094978 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:10.179641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d60f4646-239d-4e33-add4-05f8159bd095 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.922715 Aug 30 00:56:10.182350 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 27/57] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:56:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:56:10.213256 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:10.215736 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:10.228018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:10.229218 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:10.229817 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:10.231444 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:10.232147 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:10.232708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:11.567339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:11.581221 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:11.588311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:11.589475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3672d78e-08c7-4c42-a205-c70f719ec479 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 1.537078 Aug 30 00:56:11.607942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 31/58] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:10 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:11.623795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:11.624776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:11.648378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:11.648378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:11.648378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:11.648378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:11.648767 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:11.648985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:11.825903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:11.856124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-eec7b00d-37e3-4d77-937f-bf5a31417ed1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 1.664683 Aug 30 00:56:11.879828 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 28/59] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:10 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:11.883745 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:11.895943 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f4a7e170-5aaa-4735-a1a4-bb12f629e6fa tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1233 microversion: 2.1 time: 0.286359 Aug 30 00:56:11.904914 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 32/60] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:11 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1233 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:11.914975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:11.916679 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:11.949513 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:11.953329 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:11.954321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:11.956528 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:11.958286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:11.960509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:12.620490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:12.621997 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:12.629996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:12.632240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:12.641453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:12.645468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:12.646122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:12.647481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:13.250044 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:13.262308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-62e095d5-59ea-4623-8db5-51ccc7645e45 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 1.377899 Aug 30 00:56:13.277326 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=4 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:13.290796 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 29/61] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:11 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:13.299742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:13.300657 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:13.312823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:13.314827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:13.316926 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:13.318093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:13.320014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:13.320689 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:13.356643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:13.383034 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:13.385131 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:13.386580 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3fb915e4-108b-4e52-85f0-e21b87f160d7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.770923 Aug 30 00:56:13.387881 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 33/62] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:12 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:56:13.425931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:13.426975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:13.435526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:13.436438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:13.437157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:13.438199 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:13.438980 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:13.440236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:13.693260 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:13.704761 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-27ced8d7-60a6-4415-bec7-929d44dabc75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1289 microversion: 2.1 time: 0.315063 Aug 30 00:56:13.712069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 34/63] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:13 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1289 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:14.287920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:14.288679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:14.292799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=26 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:14.325589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:14.330792 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:14.339062 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:14.346043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:14.346839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:14.348435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:14.980651 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:15.006876 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2330343b-4c28-4aee-b94d-9008fffe0465 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 1.713408 Aug 30 00:56:15.008726 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 30/64] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:13 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:15.115544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-d85fb1b5-3f01-4cbf-b768-769a26c93dc1 req-b455444b-40c7-4776-b2c6-8046318cf98f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d56c98ec-9fce-4594-ae20-a22df2e99af4", "tag": "abfddcc0-2d9f-4dcd-befd-77d9702397c7"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:15.145912 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d85fb1b5-3f01-4cbf-b768-769a26c93dc1 req-b455444b-40c7-4776-b2c6-8046318cf98f service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:15.146019 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d85fb1b5-3f01-4cbf-b768-769a26c93dc1 req-b455444b-40c7-4776-b2c6-8046318cf98f service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:15.147896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d85fb1b5-3f01-4cbf-b768-769a26c93dc1 req-b455444b-40c7-4776-b2c6-8046318cf98f service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:15.208060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-d85fb1b5-3f01-4cbf-b768-769a26c93dc1 req-b455444b-40c7-4776-b2c6-8046318cf98f service nova] Creating event network-changed:abfddcc0-2d9f-4dcd-befd-77d9702397c7 for instance d56c98ec-9fce-4594-ae20-a22df2e99af4 on hv-cinder-81574 Aug 30 00:56:15.208875 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d85fb1b5-3f01-4cbf-b768-769a26c93dc1 req-b455444b-40c7-4776-b2c6-8046318cf98f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=144777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 00:56:15.212893 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d85fb1b5-3f01-4cbf-b768-769a26c93dc1 req-b455444b-40c7-4776-b2c6-8046318cf98f service nova] Acquired lock "compute-rpcapi-router" {{(pid=144777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 00:56:15.221465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:15.222053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:15.222566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:15.226757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:15.227259 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:15.230717 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:15.263630 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.compute.rpcapi [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 00:56:15.265550 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] Releasing lock "compute-rpcapi-router" {{(pid=144777) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 00:56:15.311964 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fff8dcdd-cc15-4647-af6b-cbeb50487bdc None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300265 Aug 30 00:56:15.319227 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 31/65] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:15.335883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:15.336590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:15.361297 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:15.364272 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:15.364754 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:15.366966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:15.368924 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:15.369935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:15.785712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:15.807055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cc6e9c27-5224-4f26-9b6c-ffb047d065fe tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 1.523304 Aug 30 00:56:15.812005 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 35/66] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:14 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:15.831347 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:15.833358 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:15.847348 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:15.848482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:15.849164 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:15.852296 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:15.852765 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:15.861840 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:16.598219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:16.612323 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e973fc6d-a32c-4b5d-a1ba-4bc3c58f57b8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1295 microversion: 2.1 time: 0.797698 Aug 30 00:56:16.613280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 36/67] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:15 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1295 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:16.889651 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:16.904742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:16.909578 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:16.914415 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b453bf35-f021-4746-be98-1756dde84fbc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 1.593220 Aug 30 00:56:16.915985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 32/68] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:15 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:16.930925 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-2707da03-5077-4af0-aeac-3270f52d652a req-ef623992-5447-41ad-9599-ee071c7c9f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "554fddf8-fe10-408b-a958-ea9bfa4b7bba", "tag": "db52efae-cc92-412c-bb0d-440e8cfcafe7"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:16.932139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=8 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:16.944725 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:16.947851 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:16.958338 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:16.962870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-2707da03-5077-4af0-aeac-3270f52d652a req-ef623992-5447-41ad-9599-ee071c7c9f5b service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:16.963475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-2707da03-5077-4af0-aeac-3270f52d652a req-ef623992-5447-41ad-9599-ee071c7c9f5b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:16.963912 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-2707da03-5077-4af0-aeac-3270f52d652a req-ef623992-5447-41ad-9599-ee071c7c9f5b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:16.966686 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:16.969465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:16.970155 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:16.971097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:16.975705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:16.976348 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:17.014055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-2707da03-5077-4af0-aeac-3270f52d652a req-ef623992-5447-41ad-9599-ee071c7c9f5b service nova] Creating event network-changed:db52efae-cc92-412c-bb0d-440e8cfcafe7 for instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba on hv-cinder-81574 Aug 30 00:56:17.014579 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-2707da03-5077-4af0-aeac-3270f52d652a req-ef623992-5447-41ad-9599-ee071c7c9f5b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=144776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 00:56:17.015092 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-2707da03-5077-4af0-aeac-3270f52d652a req-ef623992-5447-41ad-9599-ee071c7c9f5b service nova] Acquired lock "compute-rpcapi-router" {{(pid=144776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 00:56:17.016834 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:17.017501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:17.018097 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:17.018967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:17.019707 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:17.022674 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:17.035388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.compute.rpcapi [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 00:56:17.037889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] Releasing lock "compute-rpcapi-router" {{(pid=144776) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 00:56:17.061147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8c7130f5-714c-449f-9e82-50a983c62c2f None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.441963 Aug 30 00:56:17.062066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 37/69] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:17.069526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:17.071137 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:17.079698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:17.080492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:17.081068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:17.081908 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:17.082523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:17.083163 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:17.531874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:17.548430 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ef77103a-0a86-49d8-b5b0-38029088e8c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.484211 Aug 30 00:56:17.548939 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:17.551492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 38/70] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:17 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:17.570734 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ca0d8d5e-7f5e-46c6-bf09-202c81161436 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.636042 Aug 30 00:56:17.571608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 33/71] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:16 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:17.638204 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:17.638816 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:17.648925 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:17.649414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:17.649895 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:17.650600 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:17.651611 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:17.653113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:17.747159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:17.758643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c1a9cfe7-4bbd-437d-b039-f8999bbabe8b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1295 microversion: 2.1 time: 0.125270 Aug 30 00:56:17.759958 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 39/72] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:17 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1295 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:17.945366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:17.946704 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:17.955742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:17.956447 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:17.957029 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:17.957877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:17.959293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:17.959921 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:18.148162 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:18.163664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:18.164922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:18.166030 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a98dee76-0adb-4e5d-973e-6854c7edf80b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.229683 Aug 30 00:56:18.187263 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 34/73] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:17 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:18.574709 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:18.577278 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:18.589548 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:18.590333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:18.590955 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:18.592594 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:18.592975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:18.593808 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:18.594168 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:18.594776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:18.604263 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:18.605375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:18.605898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:18.607519 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:18.608906 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:18.609369 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:18.609798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:18.849921 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:18.860833 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ca11cd88-8905-46a5-8856-400749cc4408 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.292458 Aug 30 00:56:18.862647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 40/74] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:18 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:18.875968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:18.876865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:18.885959 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:18.886709 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:18.887219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:18.888220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:18.888679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:18.889104 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:18.930222 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:18.943997 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6419c3b3-be37-4b5c-b127-54559150d645 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.352598 Aug 30 00:56:18.945099 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 35/75] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:18 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:19.097877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:19.114750 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-95eb3bb2-62fe-4c45-be74-8dc72bca59cf req-0ba523ea-2396-4ad1-ae23-45b0076fcd27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7bbc0c-7d22-46e1-82f5-784e10ce23f3", "tag": "f8cd35a2-3f40-45d7-aeeb-e642ffc6e344"}, {"name": "network-changed", "server_uuid": "bceb6b40-b276-45b3-a56a-9bc07784ac8c", "tag": "af8730c7-2165-4ad5-b19f-0e9f6e424802"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:19.115819 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a8399cb9-0c60-4e3a-a17b-5006d8d9a3ba tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.248980 Aug 30 00:56:19.118930 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 41/76] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:18 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:19.141278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-95eb3bb2-62fe-4c45-be74-8dc72bca59cf req-0ba523ea-2396-4ad1-ae23-45b0076fcd27 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:19.142138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-95eb3bb2-62fe-4c45-be74-8dc72bca59cf req-0ba523ea-2396-4ad1-ae23-45b0076fcd27 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:19.142859 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-95eb3bb2-62fe-4c45-be74-8dc72bca59cf req-0ba523ea-2396-4ad1-ae23-45b0076fcd27 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:19.167437 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-95eb3bb2-62fe-4c45-be74-8dc72bca59cf req-0ba523ea-2396-4ad1-ae23-45b0076fcd27 service nova] Creating event network-changed:f8cd35a2-3f40-45d7-aeeb-e642ffc6e344 for instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 on hv-cinder-81574 Aug 30 00:56:19.168221 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-95eb3bb2-62fe-4c45-be74-8dc72bca59cf req-0ba523ea-2396-4ad1-ae23-45b0076fcd27 service nova] Creating event network-changed:af8730c7-2165-4ad5-b19f-0e9f6e424802 for instance bceb6b40-b276-45b3-a56a-9bc07784ac8c on hv-cinder-81574 Aug 30 00:56:19.180916 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-95eb3bb2-62fe-4c45-be74-8dc72bca59cf req-0ba523ea-2396-4ad1-ae23-45b0076fcd27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068457 Aug 30 00:56:19.182083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 36/77] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:19.195464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:19.196147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:19.209315 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:19.210017 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:19.210736 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:19.212587 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:19.213805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:19.214528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:19.427945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:19.450595 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:19.453107 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:19.456023 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-30af4b99-d80b-44fd-896e-a527adb97fea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.267499 Aug 30 00:56:19.456907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 42/78] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:19 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:19.889558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:19.890311 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:19.899293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:19.899688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:19.900304 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:19.901841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:19.902273 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:19.902895 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:19.966947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:19.967672 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:19.987903 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:19.988771 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:19.989557 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:19.991098 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:19.992513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:19.993523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:20.010450 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=22 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:20.361873 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:20.375250 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6f3b5912-4eb5-432f-99ea-dfc873fd15c5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.489216 Aug 30 00:56:20.378554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 37/79] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:19 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:20.390345 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:20.391209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:20.394747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:20.407605 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:20.408329 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:20.411630 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fe54fd7a-c029-417c-8f8d-be545268bf5f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.447337 Aug 30 00:56:20.412822 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:20.413826 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:20.414792 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 43/80] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:19 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:20.431387 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:20.432151 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:20.460067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:20.479645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:20.480255 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:20.488940 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:20.489601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:20.490126 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:20.491965 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:20.492735 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:20.493277 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:21.316508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:21.340250 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:21.342454 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:21.345451 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0e02040d-66b1-43fd-9dfe-487ef75ba973 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.868891 Aug 30 00:56:21.360429 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:21.365298 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 44/81] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:20 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:56:21.371764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-cf0a4cb6-4187-4892-99eb-df021fa9ced4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.991349 Aug 30 00:56:21.378100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 38/82] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:20 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:21.405061 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:21.405765 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:21.418733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:21.419333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:21.420839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:21.420839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:21.421009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:21.423548 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:21.438104 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:21.438832 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:21.447400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:21.447916 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:21.448446 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:21.449119 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:21.449532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:21.449971 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:21.890454 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:21.900117 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9c215b12-d817-4fa1-b73d-09117d0b43bd tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.499432 Aug 30 00:56:21.903885 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 45/83] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:21 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:22.009825 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:22.018752 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-86cebc7f-ae1d-460c-a825-fcf8d2432151 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.586044 Aug 30 00:56:22.023824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 39/84] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:21 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:22.188176 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-77fc1fbe-135c-4b46-84b3-c59b12ac6ef1 req-40470074-2159-4bdf-8f81-5024c84b6043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7655de-fe79-4bbd-abb5-5908ef3acda9", "tag": "39a645ef-ee25-4b8b-8d72-db1a360a6891"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:22.211649 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-77fc1fbe-135c-4b46-84b3-c59b12ac6ef1 req-40470074-2159-4bdf-8f81-5024c84b6043 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:22.212241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-77fc1fbe-135c-4b46-84b3-c59b12ac6ef1 req-40470074-2159-4bdf-8f81-5024c84b6043 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:22.212657 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-77fc1fbe-135c-4b46-84b3-c59b12ac6ef1 req-40470074-2159-4bdf-8f81-5024c84b6043 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:22.244056 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-77fc1fbe-135c-4b46-84b3-c59b12ac6ef1 req-40470074-2159-4bdf-8f81-5024c84b6043 service nova] Creating event network-changed:39a645ef-ee25-4b8b-8d72-db1a360a6891 for instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 on hv-cinder-81574 Aug 30 00:56:22.268861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-77fc1fbe-135c-4b46-84b3-c59b12ac6ef1 req-40470074-2159-4bdf-8f81-5024c84b6043 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084548 Aug 30 00:56:22.269798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 46/85] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:22.373502 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:22.374106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:22.382349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:22.392091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:22.393772 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:22.399914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:22.401276 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:22.401918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:22.405999 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:22.406688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:22.419883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:22.420722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:22.421334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:22.422646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:22.423417 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:22.424016 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:22.925828 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:22.937185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-afb89e0b-67a6-47fe-b86d-47a0f41fa9c3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.535252 Aug 30 00:56:22.937780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 47/86] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:22 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:22.965871 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:22.966486 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:22.981309 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:22.985802 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:22.986298 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:22.986736 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:22.987473 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:22.988043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:22.988459 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:23.001963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:23.009090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:23.015079 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f1c3a9d7-8013-4864-8f55-6db51108a96d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.644377 Aug 30 00:56:23.017681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 40/87] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:22 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:23.046702 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:23.047355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:23.058908 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:23.059616 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:23.060222 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:23.062167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:23.062847 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:23.063455 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:23.589209 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:23.603341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a96e5600-6aa9-49fc-83a9-e5d768c55657 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.646564 Aug 30 00:56:23.605689 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 48/88] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:22 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:23.605817 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:23.613834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8107fef5-c17d-4207-ac97-9bceb2f73f2c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.571293 Aug 30 00:56:23.617711 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 41/89] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:23 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:23.963071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:23.963687 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:23.982724 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:23.983571 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:23.984311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:23.985224 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:23.985858 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:23.986515 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:24.044518 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:24.045116 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:24.054994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:24.055504 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:24.056098 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:24.057069 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:24.061079 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:24.063394 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:24.220909 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:24.239644 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-806fe187-7075-43ef-a0d9-9a1d3b4b5323 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.280842 Aug 30 00:56:24.254643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 49/90] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:23 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:24.306067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:24.314760 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:24.316613 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:24.318148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b6ac95bc-ce49-4e96-a3ae-02cf2e10a730 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.278706 Aug 30 00:56:24.319984 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 42/91] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:24 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:24.625087 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:24.625687 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:24.635280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:24.635988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:24.636422 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:24.638721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:24.639353 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:24.640856 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:24.641552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:24.643164 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:24.649086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:24.649651 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:24.651287 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:24.654228 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:24.654884 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:24.655824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:25.031102 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:25.043585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-677e06f0-0c97-429a-bd7c-37a6117d27fa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.408528 Aug 30 00:56:25.047838 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 43/92] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:24 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:25.069713 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:25.084434 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d1ce6fb5-4301-4359-aa98-8b22f27107a3 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.462604 Aug 30 00:56:25.086647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 50/93] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:24 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:25.260896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:25.261225 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:25.263375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=4 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:25.269838 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:25.270608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:25.271030 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:25.271955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:25.272659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:25.273221 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:25.347913 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:25.348655 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:25.355412 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:25.356691 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:25.357374 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:25.358526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:25.359298 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:25.359929 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:25.812861 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:25.825019 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e4283148-b7e5-47a7-a473-c3278fb73c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.567665 Aug 30 00:56:25.828114 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 44/94] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:25 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:25.844236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:25.854477 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:25.856618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:25.857292 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3428badc-3a8c-43fc-8589-41f7a3105d82 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.518432 Aug 30 00:56:25.869432 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 51/95] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:25 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:56:26.066174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:26.067073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:26.079902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:26.080573 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:26.081331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:26.082180 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:26.082772 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:26.083360 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:26.108448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:26.109161 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:26.121825 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:26.124645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:26.126265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:26.127589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:26.129855 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:26.130444 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:26.405684 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:26.423059 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d140d257-21fa-49ea-8c14-3157c68e37d0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.359982 Aug 30 00:56:26.426090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 45/96] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:26 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:26.440362 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:26.446174 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-19739a3a-34c1-438c-bddd-f5827e51e8ba tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.343091 Aug 30 00:56:26.447120 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 52/97] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:26 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:26.848433 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:26.849078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:26.857752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:26.863523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:26.864173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:26.865077 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:26.865808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:26.866400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:27.033639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:27.157819 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:27.167661 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4279b625-e446-40f2-a002-a73d876a4bf0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.323138 Aug 30 00:56:27.171561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 53/98] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:26 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:27.176651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:27.183424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:27.195318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:27.197622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:27.199592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:27.200517 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:27.201500 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:27.202257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:27.406112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-11138f11-721c-42f6-bd14-8119f364211b req-1e71cfa0-e552-4e4f-b6ec-8edd6b13ab9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554fddf8-fe10-408b-a958-ea9bfa4b7bba", "name": "network-vif-plugged", "status": "completed", "tag": "db52efae-cc92-412c-bb0d-440e8cfcafe7"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:27.449986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-11138f11-721c-42f6-bd14-8119f364211b req-1e71cfa0-e552-4e4f-b6ec-8edd6b13ab9c service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:27.460175 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-11138f11-721c-42f6-bd14-8119f364211b req-1e71cfa0-e552-4e4f-b6ec-8edd6b13ab9c service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:27.462880 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-11138f11-721c-42f6-bd14-8119f364211b req-1e71cfa0-e552-4e4f-b6ec-8edd6b13ab9c service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:27.494958 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-11138f11-721c-42f6-bd14-8119f364211b req-1e71cfa0-e552-4e4f-b6ec-8edd6b13ab9c service nova] Creating event network-vif-plugged:db52efae-cc92-412c-bb0d-440e8cfcafe7 for instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba on hv-cinder-81574 Aug 30 00:56:27.502661 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:27.509361 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-11138f11-721c-42f6-bd14-8119f364211b req-1e71cfa0-e552-4e4f-b6ec-8edd6b13ab9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.806345 Aug 30 00:56:27.515932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 46/99] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:27.525721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:27.527469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:27.528855 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f8a954f9-151a-44ba-8880-387eb13610ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.356144 Aug 30 00:56:27.529822 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 54/100] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:27 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:27.530908 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:27.533626 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:27.547764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:27.549771 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:27.551839 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:27.553047 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:27.554370 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:27.558681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:27.560189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:27.560844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:27.574401 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:27.578321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:27.579419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:27.583133 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:27.583793 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:27.585258 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:27.977005 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:27.994946 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3aeb36e5-325c-4c3c-84cf-77c92b7ce007 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.476514 Aug 30 00:56:27.995591 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:27.996359 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 47/101] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:27 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:28.017577 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bd70d742-7aa5-4c50-a596-aa47ce7ccc03 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.486536 Aug 30 00:56:28.018473 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 55/102] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:27 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:28.197195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:28.198310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:28.211564 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:28.213940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:28.215595 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:28.229263 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:28.236788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:28.238210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:28.499987 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:28.511797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a09ea4f5-796b-4b20-82c3-aebfa697693b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.321237 Aug 30 00:56:28.512381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 48/103] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:28 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:28.554283 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:28.555768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:28.565140 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:28.566003 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:28.566656 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:28.567736 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:28.568731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:28.569287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:28.741973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:28.771445 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:28.773660 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:28.776406 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7ae2ff97-d8e8-4d45-8127-0f81c1a65f50 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.227387 Aug 30 00:56:28.784213 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 56/104] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:28 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:29.017319 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:29.018003 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:29.026103 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.026670 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.027364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:29.028141 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.028680 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.029255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:29.040114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:29.041410 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:29.052472 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.053292 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.053873 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:29.054718 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.055380 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.055951 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:29.075697 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:29.254841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:29.265276 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-23bc99f3-b6f2-417b-bdee-c96356abfe43 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.252430 Aug 30 00:56:29.266903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 49/105] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:29 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:29.269093 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:29.280294 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-080ef4cf-5d08-439d-8192-8aaa6f476a0a tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1314 microversion: 2.1 time: 0.244143 Aug 30 00:56:29.280877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 57/106] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:29 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:29.529793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56c98ec-9fce-4594-ae20-a22df2e99af4", "name": "network-vif-plugged", "status": "completed", "tag": "abfddcc0-2d9f-4dcd-befd-77d9702397c7"}, {"server_uuid": "fe7bbc0c-7d22-46e1-82f5-784e10ce23f3", "name": "network-vif-plugged", "status": "completed", "tag": "f8cd35a2-3f40-45d7-aeeb-e642ffc6e344"}, {"server_uuid": "bceb6b40-b276-45b3-a56a-9bc07784ac8c", "name": "network-vif-plugged", "status": "completed", "tag": "af8730c7-2165-4ad5-b19f-0e9f6e424802"}, {"server_uuid": "7d7655de-fe79-4bbd-abb5-5908ef3acda9", "name": "network-vif-plugged", "status": "completed", "tag": "39a645ef-ee25-4b8b-8d72-db1a360a6891"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:29.534280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:29.535587 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:29.547672 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.547835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.548173 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.548292 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.548588 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:29.548822 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:29.549532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.549976 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.550392 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:29.568824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] Creating event network-vif-plugged:abfddcc0-2d9f-4dcd-befd-77d9702397c7 for instance d56c98ec-9fce-4594-ae20-a22df2e99af4 on hv-cinder-81574 Aug 30 00:56:29.571600 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] Creating event network-vif-plugged:f8cd35a2-3f40-45d7-aeeb-e642ffc6e344 for instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 on hv-cinder-81574 Aug 30 00:56:29.572630 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] Creating event network-vif-plugged:af8730c7-2165-4ad5-b19f-0e9f6e424802 for instance bceb6b40-b276-45b3-a56a-9bc07784ac8c on hv-cinder-81574 Aug 30 00:56:29.573127 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] Creating event network-vif-plugged:39a645ef-ee25-4b8b-8d72-db1a360a6891 for instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 on hv-cinder-81574 Aug 30 00:56:29.585153 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-a0d08088-6a24-4a56-b06e-3b128301aa0c req-2ed99681-d2ec-4104-8305-c75edbc895c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.058810 Aug 30 00:56:29.585835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 50/107] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:29.696205 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:29.704834 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-13144caa-a150-4b5b-b803-fcee5e5af7f3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.176206 Aug 30 00:56:29.706659 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 58/108] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:29 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:29.803195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:29.805834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:29.818968 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.819777 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.820590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:29.821329 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:29.821928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:29.822470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:30.073450 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:30.084569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:30.087428 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:30.089342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2ba56a98-c678-46f2-9ef9-4ff86bd5c9c2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.291002 Aug 30 00:56:30.090566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 51/109] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:29 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:30.288217 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:30.289423 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:30.296216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:30.296903 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:30.297576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:30.298650 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:30.299343 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:30.299901 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:30.314600 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:30.315677 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:30.324877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:30.325786 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:30.326427 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:30.327390 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:30.328061 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:30.328901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:30.509463 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:30.538258 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-21a0a736-b5ee-4e57-9c34-3a80a4540bb9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.250126 Aug 30 00:56:30.540018 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 59/110] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:30 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:30.555975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:30.565899 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c077f8e0-cce3-499c-97c9-4bdd83df697c tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1498 microversion: 2.1 time: 0.267624 Aug 30 00:56:30.567753 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 52/111] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:30 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1498 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:30.727507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:30.728439 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:30.734960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:30.735614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:30.736075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:30.736753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:30.737194 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:30.737599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:30.885783 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:30.911841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c860d029-8b0a-427a-96eb-4c858e2f125f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.188335 Aug 30 00:56:30.923168 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 60/112] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:30 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:31.116242 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:31.117137 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:31.128985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:31.129602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:31.130057 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:31.131510 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:31.132264 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:31.132855 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:31.270587 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:31.278847 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:31.280310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:31.281419 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9b94f886-6023-454b-b42c-1e3e37a02c22 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1406 microversion: 2.20 time: 0.169151 Aug 30 00:56:31.281975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 53/113] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:31 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:31.564634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:31.565219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:31.572038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:31.572515 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:31.573130 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:31.573822 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:31.575119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:31.575559 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:31.728098 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:31.736474 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f0274990-b1ea-4cd1-8afa-73aeda1eab39 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.175716 Aug 30 00:56:31.737345 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 61/114] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:31 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:31.933518 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:31.934360 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:31.940490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:31.941032 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:31.941661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:31.942348 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:31.942789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:31.943709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:32.034289 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65b52e61-53bd-4e65-9c52-8da21f56b373"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:32.037695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:32.044786 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:32.045375 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:32.046243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:32.047256 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:32.047830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:32.048310 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:32.080968 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:32.099974 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-54abc507-d73b-411f-9622-ec19c59288cf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1362 microversion: 2.1 time: 0.170112 Aug 30 00:56:32.119299 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 54/115] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:31 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:32.304314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:32.304953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:32.310922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:32.311469 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:32.311895 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:32.312551 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:32.313178 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:32.313572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:32.466248 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:32.475312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:32.477520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:32.478893 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-726155f1-2f71-45bc-92d2-cc078ff67fb8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1598 microversion: 2.20 time: 0.178802 Aug 30 00:56:32.479488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 55/116] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:56:32 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1598 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:56:32.502290 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:32.502789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:32.509417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:32.509867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:32.510474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:32.511212 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:32.511658 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:32.512271 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:32.570894 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:32.649448 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a86adc29-33ab-4783-9bb6-8f5fa2669883 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151158 Aug 30 00:56:32.650190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 56/117] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Aug 30 00:56:32 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 00:56:32.760541 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:32.762615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:32.772547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:32.773424 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:32.773854 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:32.774981 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:32.775458 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:32.776052 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:33.004250 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:33.017205 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-83a00773-4267-450b-ac2e-960fb019c905 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1321 microversion: 2.1 time: 0.262145 Aug 30 00:56:33.018439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 57/118] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:32 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:33.134470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:33.135442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:33.143700 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:33.144593 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:33.145198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:33.146090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:33.146754 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:33.147531 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:33.330487 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:33.340723 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-931a48ad-6725-4bd6-a618-d38d0a4e5abe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1546 microversion: 2.1 time: 0.214925 Aug 30 00:56:33.342547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 58/119] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:33 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1546 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:33.364618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:33.366356 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:33.374406 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:33.375400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:33.376263 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:33.377236 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:33.377883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:33.378556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:33.478356 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b8faa552-8386-42ec-9a2a-b27b9daef7c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117749 Aug 30 00:56:33.479590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 59/120] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 30 00:56:33 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:56:34.039912 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:34.041183 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:34.050430 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:34.051217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:34.052008 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:34.054681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:34.055342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:34.055986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:34.725330 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:34.770338 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9cadfacf-a1b0-452c-99f6-bceb8458e2a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1515 microversion: 2.1 time: 0.734775 Aug 30 00:56:34.770939 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 60/121] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:34 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1515 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:34.794344 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-cd996b32-f079-4c10-9c2d-4f06975e9858 req-9461c99c-a90d-47b8-b884-2c684b561057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7bbc0c-7d22-46e1-82f5-784e10ce23f3", "tag": "f8cd35a2-3f40-45d7-aeeb-e642ffc6e344"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:34.810591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cd996b32-f079-4c10-9c2d-4f06975e9858 req-9461c99c-a90d-47b8-b884-2c684b561057 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:34.811298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cd996b32-f079-4c10-9c2d-4f06975e9858 req-9461c99c-a90d-47b8-b884-2c684b561057 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:34.811843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cd996b32-f079-4c10-9c2d-4f06975e9858 req-9461c99c-a90d-47b8-b884-2c684b561057 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:34.838153 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-cd996b32-f079-4c10-9c2d-4f06975e9858 req-9461c99c-a90d-47b8-b884-2c684b561057 service nova] Creating event network-changed:f8cd35a2-3f40-45d7-aeeb-e642ffc6e344 for instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 on hv-cinder-81574 Aug 30 00:56:34.844444 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-cd996b32-f079-4c10-9c2d-4f06975e9858 req-9461c99c-a90d-47b8-b884-2c684b561057 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071964 Aug 30 00:56:34.851932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 61/122] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:34.872056 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:34.879931 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:34.888484 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:34.888942 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:34.889944 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:34.890796 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:34.891234 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:34.891880 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:34.922589 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lazy-loading 'flavor' on Instance uuid bceb6b40-b276-45b3-a56a-9bc07784ac8c {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:56:35.080068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f5caa8a6-d35b-441e-a1d4-f3d4846e84f7 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "POST /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.049958 Aug 30 00:56:35.087900 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 62/123] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 00:56:32 2022] POST /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba/os-volume_attachments => generated 194 bytes in 3053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:56:35.105715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e00cc60e-f52e-4abf-ba59-a8d990b2a757 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c/action" status: 200 len: 32 microversion: 2.1 time: 0.252090 Aug 30 00:56:35.107169 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 62/124] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:56:34 2022] POST /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:56:35.117933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:35.118786 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:35.126087 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:35.126830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:35.127300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:35.127999 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:35.128447 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:35.128865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:35.365189 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:35.393472 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b2ea57e0-f13e-421a-856c-feeef2a596f9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.280248 Aug 30 00:56:35.407799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 63/125] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:35 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:35.658681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-3fa29da1-79a3-43d8-a443-1f47675b8a22 req-2f6781da-da27-40d1-a891-c2ae6926a6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7655de-fe79-4bbd-abb5-5908ef3acda9", "tag": "39a645ef-ee25-4b8b-8d72-db1a360a6891"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:35.671106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-3fa29da1-79a3-43d8-a443-1f47675b8a22 req-2f6781da-da27-40d1-a891-c2ae6926a6a3 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:35.675866 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-3fa29da1-79a3-43d8-a443-1f47675b8a22 req-2f6781da-da27-40d1-a891-c2ae6926a6a3 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:35.676490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-3fa29da1-79a3-43d8-a443-1f47675b8a22 req-2f6781da-da27-40d1-a891-c2ae6926a6a3 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:35.689836 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-3fa29da1-79a3-43d8-a443-1f47675b8a22 req-2f6781da-da27-40d1-a891-c2ae6926a6a3 service nova] Creating event network-changed:39a645ef-ee25-4b8b-8d72-db1a360a6891 for instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 on hv-cinder-81574 Aug 30 00:56:35.696273 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-3fa29da1-79a3-43d8-a443-1f47675b8a22 req-2f6781da-da27-40d1-a891-c2ae6926a6a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042025 Aug 30 00:56:35.696877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 63/126] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:36.415724 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:36.417132 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:36.424062 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:36.424546 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:36.424974 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:36.425940 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:36.426587 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:36.427034 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:36.669931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:36.683767 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6a07e34e-eaf1-4ccf-bb9d-5c9054431fd8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.272748 Aug 30 00:56:36.686163 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 64/127] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:36 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:37.709366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:37.710046 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:37.716442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:37.716920 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:37.717348 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:37.718024 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:37.718467 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:37.718881 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:37.860058 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:37.873403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-17fc2a55-0cd0-4d3c-9231-7ac428b812bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.170608 Aug 30 00:56:37.874044 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 64/128] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:37 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:38.895631 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:38.896673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:38.903491 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:38.903991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:38.904497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:38.905155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:38.905614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:38.906030 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:39.048102 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:39.056552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ee816e80-c06d-49ac-8870-a8e8fbd37a35 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.164738 Aug 30 00:56:39.057317 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 65/129] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:38 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:40.078734 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:40.079439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:40.085759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:40.086314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:40.086844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:40.087623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:40.088096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:40.088520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:40.519677 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:40.528234 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-340c2bbb-6187-491d-b583-ffd479a5156f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.454065 Aug 30 00:56:40.528960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 65/130] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:40 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:41.555049 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:41.556935 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:41.565469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:41.565969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:41.566343 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:41.567693 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:41.569322 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:41.569854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:41.722615 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:41.731211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-eb2a3bdc-e819-457d-86f4-0e61c2f4447e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.185414 Aug 30 00:56:41.731772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 66/131] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:41 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:42.750870 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1260988776", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "networks": [{"uuid": "390f925d-047e-4666-8d10-c80e4334b0c3"}]}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:42.752950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:42.753570 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:42.764766 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:42.765629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:42.766220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:42.767096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:42.768191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:42.769029 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:42.830806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] validate_networks() for [('390f925d-047e-4666-8d10-c80e4334b0c3', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:56:43.023066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:43.030908 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a9f2018a-420f-4691-ace4-8979e009a165 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.281699 Aug 30 00:56:43.031496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 67/132] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:42 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:43.300397 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:56:43.300820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:56:43.301281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:56:43.301709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:56:43.302076 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:56:43.310888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:43.311383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:43.311800 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:43.312498 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:43.312946 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:43.313345 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:43.331584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Getting quotas for project 5b70056e81304145a833c88ea096e76d. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:56:43.335562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Getting quotas for user 309da81b8e13455a836e0c8435ed6b06 and project 5b70056e81304145a833c88ea096e76d. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:56:43.346373 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:56:43.348698 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:56:43.398393 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0e354900-9aa6-4c0d-9b79-c70e3be92df0 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652631 Aug 30 00:56:43.404996 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 66/133] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:56:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:56:43.410997 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b0fc7025-3ac7-47da-9149-de588b8104df tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:43.411558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b0fc7025-3ac7-47da-9149-de588b8104df tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:43.474285 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b0fc7025-3ac7-47da-9149-de588b8104df tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:43.482057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b0fc7025-3ac7-47da-9149-de588b8104df tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1214 microversion: 2.1 time: 0.074992 Aug 30 00:56:43.483955 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 68/134] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:43 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:43.951978 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:43.953157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:43.959759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:43.960555 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:43.961209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:43.962128 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:43.962766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:43.963459 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:43.998519 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:56:44.054688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:44.056332 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:44.066073 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:44.066688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:44.067191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:44.068268 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:44.068908 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:44.069435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:44.156503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-84a97133-b474-4072-b6c2-58fd7dc02f98 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "DELETE /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 204 len: 0 microversion: 2.1 time: 0.208249 Aug 30 00:56:44.157325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 67/135] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 00:56:43 2022] DELETE /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:56:44.169141 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:44.170123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:44.177521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:44.178535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:44.180514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:44.181440 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:44.182221 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:44.182810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:44.325548 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:44.341768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cbfb6ad8-2c51-4f11-a2ae-1fc66d8b5f25 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.292692 Aug 30 00:56:44.358161 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 69/136] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:44 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:44.372281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:44.380619 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d765123d-2732-4134-9b92-0dc34f78c28e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1550 microversion: 2.1 time: 0.218361 Aug 30 00:56:44.388195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 68/137] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:44 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1550 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:44.506899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:44.507615 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:44.515636 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:44.516272 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:44.516942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:44.517646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:44.518193 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:44.518668 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:44.607772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:44.618367 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6e87c28d-f9fd-41c0-bbcc-735e5fc4b258 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1266 microversion: 2.1 time: 0.117255 Aug 30 00:56:44.618961 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 70/138] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:44 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:45.365842 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:45.366455 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:45.372820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:45.373299 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:45.373729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:45.374415 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:45.374862 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:45.375297 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:45.404817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:45.406114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:45.413407 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:45.414231 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:45.414985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:45.415771 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:45.416219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:45.416636 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:45.582331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:45.601447 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-987a1cee-5b77-497b-971e-791f0cefe401 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.239976 Aug 30 00:56:45.602039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 69/139] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:45 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:45.639520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:45.640125 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:45.646066 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:45.646542 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:45.647193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:45.648112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:45.648706 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:45.651308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:45.652973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:45.663516 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-76048fee-3b50-4bdb-9456-c9ee487cdaef tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1550 microversion: 2.1 time: 0.265548 Aug 30 00:56:45.664780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 71/140] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:45 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1550 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:45.734659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:45.746990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fcdb6a69-ed34-4a4d-bdea-185143c3e26a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1266 microversion: 2.1 time: 0.110140 Aug 30 00:56:45.747890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 70/141] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:45 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:46.626127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:46.626732 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:46.634042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:46.634763 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:46.635431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:46.636119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:46.636559 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:46.636957 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:46.692930 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:46.693787 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:46.703401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:46.704379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:46.708053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:46.709309 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:46.710049 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:46.710583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:46.850918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:46.860507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c2d36896-cd2a-49f3-81ce-f6c4cc54cf38 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.238800 Aug 30 00:56:46.872869 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 72/142] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:46 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:46.879157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:46.879957 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:46.886645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:46.888099 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:46.888557 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:46.889439 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:46.890033 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:46.890594 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:46.927696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:46.938932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-20278a00-592e-4a40-baf8-699c46367dea tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1550 microversion: 2.1 time: 0.256396 Aug 30 00:56:46.940285 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 71/143] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:46 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1550 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:47.022831 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:47.027039 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:47.034673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c9075ced-8692-4d69-ae5f-2bc165eca9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1266 microversion: 2.1 time: 0.159335 Aug 30 00:56:47.039680 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 73/144] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:46 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:47.884220 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:47.885002 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:47.889141 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:47.901679 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:47.904292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:47.905043 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:47.906197 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:47.907031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:47.907764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:47.916184 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:47.970638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:47.972159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:47.987166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=76 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:48.007783 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:48.008583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:48.009248 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:48.010208 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:48.013153 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:48.014251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:48.168707 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:48.190101 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f52a68a9-4adf-4343-8134-1e0330ad1e2f tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1508 microversion: 2.1 time: 0.229478 Aug 30 00:56:48.191470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 74/145] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:47 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:48.198894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:48.199747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:48.209690 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:48.210620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:48.211415 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:48.212333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:48.212991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:48.213518 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:48.477695 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:48.489347 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-304be1ef-f533-4b9d-8e32-c221df00de65 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.610464 Aug 30 00:56:48.490040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 72/146] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:47 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:48.509475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-9c5d89bb-f7bc-42f1-84e3-9459d8069968 req-d1348cf6-642e-4ecb-9355-cd13d159b130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554fddf8-fe10-408b-a958-ea9bfa4b7bba", "name": "network-vif-deleted", "tag": "db52efae-cc92-412c-bb0d-440e8cfcafe7"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:48.528774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-9c5d89bb-f7bc-42f1-84e3-9459d8069968 req-d1348cf6-642e-4ecb-9355-cd13d159b130 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:48.529243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-9c5d89bb-f7bc-42f1-84e3-9459d8069968 req-d1348cf6-642e-4ecb-9355-cd13d159b130 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:48.529666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-9c5d89bb-f7bc-42f1-84e3-9459d8069968 req-d1348cf6-642e-4ecb-9355-cd13d159b130 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:48.558466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-9c5d89bb-f7bc-42f1-84e3-9459d8069968 req-d1348cf6-642e-4ecb-9355-cd13d159b130 service nova] Creating event network-vif-deleted:db52efae-cc92-412c-bb0d-440e8cfcafe7 for instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba on hv-cinder-81574 Aug 30 00:56:48.564284 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-9c5d89bb-f7bc-42f1-84e3-9459d8069968 req-d1348cf6-642e-4ecb-9355-cd13d159b130 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058634 Aug 30 00:56:48.565615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 73/147] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:56:48.584883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:48.595721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bf7fd0c6-03d8-4802-b5e9-f4b91dde3cb7 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.401720 Aug 30 00:56:48.596789 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 75/148] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:48 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:48.999813 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-cc6715ea-940d-4fb0-a534-3031a6cee070 req-16fd97b6-72a7-46ba-ae00-854ebfde61b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30ab130-80b9-483c-bf13-f7ad54a3eb06", "tag": "8d260501-cebd-4e84-8c1d-b67929828736"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:49.014780 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cc6715ea-940d-4fb0-a534-3031a6cee070 req-16fd97b6-72a7-46ba-ae00-854ebfde61b2 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:49.015261 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cc6715ea-940d-4fb0-a534-3031a6cee070 req-16fd97b6-72a7-46ba-ae00-854ebfde61b2 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:49.015672 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cc6715ea-940d-4fb0-a534-3031a6cee070 req-16fd97b6-72a7-46ba-ae00-854ebfde61b2 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:49.029894 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-cc6715ea-940d-4fb0-a534-3031a6cee070 req-16fd97b6-72a7-46ba-ae00-854ebfde61b2 service nova] Creating event network-changed:8d260501-cebd-4e84-8c1d-b67929828736 for instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 on hv-cinder-81574 Aug 30 00:56:49.041982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-cc6715ea-940d-4fb0-a534-3031a6cee070 req-16fd97b6-72a7-46ba-ae00-854ebfde61b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051166 Aug 30 00:56:49.042761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 74/149] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:49.215058 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:49.215667 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:49.223496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:49.223981 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:49.224411 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:49.225375 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:49.226109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:49.226622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:49.261864 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:49.262350 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:49.262848 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:49.263339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lazy-loading 'fault' on Instance uuid 554fddf8-fe10-408b-a958-ea9bfa4b7bba {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:56:49.329221 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e5c1345e4049f0bf5fc17ef71b7133', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ab0b517d41b4b83af9af6f1fcce13d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:49.340413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dd95c0fb-c8c0-4fc2-9c82-2a0d1336ad6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 200 len: 1350 microversion: 2.1 time: 0.129782 Aug 30 00:56:49.341172 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 76/150] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:49 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:49.512945 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:49.513849 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:49.521509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:49.522098 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:49.522521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:49.523334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:49.523777 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:49.524197 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:49.618362 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:49.619243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:49.626977 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:49.627583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:49.628078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:49.628829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:49.629639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:49.630054 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:49.697431 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:49.706660 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0a9d0b09-4b51-4dd3-915c-def858122648 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.198900 Aug 30 00:56:49.707793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 75/151] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:49 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:49.821842 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:49.831755 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d26aa2f4-4aaf-4f23-b10e-8dd3e2cd6515 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.217400 Aug 30 00:56:49.833051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 77/152] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:49 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:50.362786 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:50.363403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:50.370287 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:50.370775 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:50.371234 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:50.371933 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:50.372374 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:50.372779 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:50.387575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] HTTP exception thrown: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Request method failure captured: Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba HTTP/1.1 Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAY4AThuNPQ_623xLhHKedcyQZ4_yS__3xct6cSaoz6O4GkXguPOOenHmBK7YpCuuB3IjpoKxvTeCcSYEgwia7GCephkssebwUhN3xkkUrPzMnte0HBTNnnMq5zlH48iYc7aLbslOUJFynGl_ZMvp_CiiEPIowe-DQzgSfrFEddWrs Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 1ab0b517d41b4b83af9af6f1fcce13d7 Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:56:50.398067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ab0b517d41b4b83af9af6f1fcce13d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ab0b517d41b4b83af9af6f1fcce13d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab0b517d41b4b83af9af6f1fcce13d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab0b517d41b4b83af9af6f1fcce13d7"}]}] Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 1ab0b517d41b4b83af9af6f1fcce13d7 Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-DeleteServersTestJSON-1168705791-project Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: e0e5c1345e4049f0bf5fc17ef71b7133 Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-DeleteServersTestJSON-1168705791-project Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.399509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '554fddf8-fe10-408b-a958-ea9bfa4b7bba'} Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:56:50.400355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.401829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.403144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Returning 404 to user: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:56:50.403144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4eaffac4-2d24-41d0-9cd2-55eab765dc6e tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 404 len: 111 microversion: 2.1 time: 0.041118 Aug 30 00:56:50.403144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 76/153] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:50 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:56:50.527182 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:50.529514 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:50.536290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:50.536750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:50.537175 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:50.537997 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:50.538585 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:50.539336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:50.554583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] HTTP exception thrown: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Request method failure captured: Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba/os-volume_attachments HTTP/1.1 Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAY4AThuNPQ_623xLhHKedcyQZ4_yS__3xct6cSaoz6O4GkXguPOOenHmBK7YpCuuB3IjpoKxvTeCcSYEgwia7GCephkssebwUhN3xkkUrPzMnte0HBTNnnMq5zlH48iYc7aLbslOUJFynGl_ZMvp_CiiEPIowe-DQzgSfrFEddWrs Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 1ab0b517d41b4b83af9af6f1fcce13d7 Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 00:56:50.558731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ab0b517d41b4b83af9af6f1fcce13d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ab0b517d41b4b83af9af6f1fcce13d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab0b517d41b4b83af9af6f1fcce13d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab0b517d41b4b83af9af6f1fcce13d7"}]}] Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 1ab0b517d41b4b83af9af6f1fcce13d7 Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-DeleteServersTestJSON-1168705791-project Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: e0e5c1345e4049f0bf5fc17ef71b7133 Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-DeleteServersTestJSON-1168705791-project Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.560173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'server_id': '554fddf8-fe10-408b-a958-ea9bfa4b7bba'} Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:56:50.560945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:50.562273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:50.563584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Returning 404 to user: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:56:50.563584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5cd99956-7bbd-4e6e-94f5-8367703541cc tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037230 Aug 30 00:56:50.563584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 78/154] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 00:56:50 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:56:50.729975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:50.730615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:50.736972 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:50.737526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:50.738046 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:50.738736 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:50.739211 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:50.739641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:50.859975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:50.860685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:50.867459 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:50.867985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:50.868400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:50.869084 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:50.869519 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:50.869929 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:50.878556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:50.886697 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c9a80aba-260a-4a1d-8c55-633725d9b0c9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.161351 Aug 30 00:56:50.887671 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 77/155] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:50 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:51.006187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:51.016215 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d8161c9a-ac55-4697-b5a1-a2b2c9345162 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.160103 Aug 30 00:56:51.016790 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 79/156] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:50 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:51.777237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:51.777799 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:51.784002 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:51.784477 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:51.784919 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:51.785568 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:51.786010 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:51.786419 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:51.800393 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] HTTP exception thrown: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Request method failure captured: Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: DELETE /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba HTTP/1.1 Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAY4AThuNPQ_623xLhHKedcyQZ4_yS__3xct6cSaoz6O4GkXguPOOenHmBK7YpCuuB3IjpoKxvTeCcSYEgwia7GCephkssebwUhN3xkkUrPzMnte0HBTNnnMq5zlH48iYc7aLbslOUJFynGl_ZMvp_CiiEPIowe-DQzgSfrFEddWrs Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 1ab0b517d41b4b83af9af6f1fcce13d7 Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:56:51.801991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ab0b517d41b4b83af9af6f1fcce13d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ab0b517d41b4b83af9af6f1fcce13d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab0b517d41b4b83af9af6f1fcce13d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab0b517d41b4b83af9af6f1fcce13d7"}]}] Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 1ab0b517d41b4b83af9af6f1fcce13d7 Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-DeleteServersTestJSON-1168705791-project Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: e0e5c1345e4049f0bf5fc17ef71b7133 Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-DeleteServersTestJSON-1168705791-project Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.803254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '554fddf8-fe10-408b-a958-ea9bfa4b7bba'} Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:56:51.805243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.806602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.807994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Returning 404 to user: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:56:51.807994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-47c8cb72-c1ba-451f-9ce8-ffa6eff424d5 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "DELETE /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 404 len: 111 microversion: 2.1 time: 0.031401 Aug 30 00:56:51.807994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 78/157] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 00:56:51 2022] DELETE /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:56:51.812122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:51.812721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] [instance: 554fddf8-fe10-408b-a958-ea9bfa4b7bba] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:51.821003 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:51.821450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:51.821877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:51.822570 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:51.823036 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:51.823461 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:51.838113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] HTTP exception thrown: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Request method failure captured: Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba HTTP/1.1 Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAY4AThuNPQ_623xLhHKedcyQZ4_yS__3xct6cSaoz6O4GkXguPOOenHmBK7YpCuuB3IjpoKxvTeCcSYEgwia7GCephkssebwUhN3xkkUrPzMnte0HBTNnnMq5zlH48iYc7aLbslOUJFynGl_ZMvp_CiiEPIowe-DQzgSfrFEddWrs Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 1ab0b517d41b4b83af9af6f1fcce13d7 Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 00:56:51.840309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1ab0b517d41b4b83af9af6f1fcce13d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1ab0b517d41b4b83af9af6f1fcce13d7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab0b517d41b4b83af9af6f1fcce13d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1ab0b517d41b4b83af9af6f1fcce13d7"}]}] Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 1ab0b517d41b4b83af9af6f1fcce13d7 Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-DeleteServersTestJSON-1168705791 Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-DeleteServersTestJSON-1168705791-project Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: e0e5c1345e4049f0bf5fc17ef71b7133 Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-DeleteServersTestJSON-1168705791-project Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.841947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '554fddf8-fe10-408b-a958-ea9bfa4b7bba'} Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:56:51.842922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. Aug 30 00:56:51.845244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:56:51.846404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] Returning 404 to user: Instance 554fddf8-fe10-408b-a958-ea9bfa4b7bba could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:56:51.846404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-170201f9-b27f-407b-aa2d-104cf16f8b35 tempest-DeleteServersTestJSON-1168705791 tempest-DeleteServersTestJSON-1168705791-project] 10.222.0.17 "GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba" status: 404 len: 111 microversion: 2.1 time: 0.034391 Aug 30 00:56:51.846404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 80/158] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:51 2022] GET /compute/v2.1/servers/554fddf8-fe10-408b-a958-ea9bfa4b7bba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 00:56:51.907851 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:51.908451 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:51.915669 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:51.916152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:51.916579 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:51.917279 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:51.917727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:51.918633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:52.041294 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:52.042254 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:52.051660 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:52.052398 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:52.053130 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:52.054097 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:52.054852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:52.055463 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:52.071649 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:52.080972 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d2508621-b322-4830-8f0b-43e832fb1e9b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.176836 Aug 30 00:56:52.081992 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 79/159] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:51 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:52.209150 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:52.217609 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-071dad08-216e-4394-9fb5-4f507906f884 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.184175 Aug 30 00:56:52.218105 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 81/160] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:52 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:56:53.102882 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:53.103943 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:53.116532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:53.117027 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:53.117682 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:53.118743 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:53.119971 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:53.120590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:53.246170 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:53.247079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:53.259665 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:53.260441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:53.260884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:53.261758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:53.262779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:53.263245 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:53.286244 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:53.296376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b3ad3b68-ae49-4466-8a42-b2dcfc0cd86e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.197464 Aug 30 00:56:53.312781 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 80/161] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:53 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:53.451118 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:53.458748 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-eae04d7a-f17e-401a-9d41-9c5b44cfd8d5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.221772 Aug 30 00:56:53.459350 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 82/162] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:53 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:54.320352 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:54.321111 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:54.323357 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:54.324618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:54.330666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:54.331354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:54.331883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:54.332689 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:54.333403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:54.333921 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:54.481449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:54.482680 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:54.495949 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:56:54.502391 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:54.502898 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:54.509799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:54.510608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:54.516510 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:54.517103 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:54.534583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:54.561111 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3467ede9-10fa-4a47-a81e-3830439ccba1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.232766 Aug 30 00:56:54.564039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 81/163] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:54 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:54.885289 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:54.894257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-45046616-5e27-40a4-ad6f-2fd16a481b7a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.416036 Aug 30 00:56:54.907673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 83/164] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:54 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:55.587217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:55.588428 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:55.595913 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:55.596409 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:55.596840 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:55.597558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:55.598004 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:55.599037 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:55.818070 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:55.826918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5120549e-e173-499f-9ee2-0aec38daecf4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.244523 Aug 30 00:56:55.827514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 82/165] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:55 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:55.916212 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:55.916943 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:55.923087 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:55.923561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:55.923987 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:55.924663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:55.925103 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:55.925510 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:56.142585 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:56.157730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6f3f28a8-b7aa-4207-9baa-aa4c27076d57 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.245537 Aug 30 00:56:56.171096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 84/166] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:55 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:56.175166 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-f857f073-8677-4997-98b2-685e820eb1f3 req-f5995e0d-5535-4a7b-a205-722f00a9d8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30ab130-80b9-483c-bf13-f7ad54a3eb06", "name": "network-vif-plugged", "status": "completed", "tag": "8d260501-cebd-4e84-8c1d-b67929828736"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:56:56.186158 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-f857f073-8677-4997-98b2-685e820eb1f3 req-f5995e0d-5535-4a7b-a205-722f00a9d8bf service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:56.186855 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-f857f073-8677-4997-98b2-685e820eb1f3 req-f5995e0d-5535-4a7b-a205-722f00a9d8bf service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:56.187453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-f857f073-8677-4997-98b2-685e820eb1f3 req-f5995e0d-5535-4a7b-a205-722f00a9d8bf service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:56.201162 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-f857f073-8677-4997-98b2-685e820eb1f3 req-f5995e0d-5535-4a7b-a205-722f00a9d8bf service nova] Creating event network-vif-plugged:8d260501-cebd-4e84-8c1d-b67929828736 for instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 on hv-cinder-81574 Aug 30 00:56:56.207123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-f857f073-8677-4997-98b2-685e820eb1f3 req-f5995e0d-5535-4a7b-a205-722f00a9d8bf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045544 Aug 30 00:56:56.207759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 83/167] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:56:56.848774 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:56.849387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:56.856404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:56.856821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:56.857253 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:56.857956 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:56.858409 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:56.858833 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:57.043784 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:57.051672 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5278b7b6-4fe7-41fc-8744-437afd9002bc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.206929 Aug 30 00:56:57.052238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 85/168] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:56 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:57.179591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:57.181202 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:57.191351 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:57.192255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:57.193619 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:57.195123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:57.196173 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:57.197126 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:57.368521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:57.377746 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-69f52dd2-4c37-4bbc-8d79-fa983f185e76 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.202991 Aug 30 00:56:57.378330 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 84/169] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:57 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:58.074904 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:58.076185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:58.083075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:58.083552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:58.084124 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:58.084873 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:58.085768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:58.085978 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:58.244220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:58.252283 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c69621b9-c43b-4cdc-870d-6728dadea492 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.181689 Aug 30 00:56:58.252871 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 86/170] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:58 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:58.399536 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:58.400747 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:58.407885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:58.408556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:58.409535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:58.410462 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:58.411154 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:58.411765 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:58.593787 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:58.602126 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5297e392-45f4-403a-a9e8-f9c2000aa94f tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1314 microversion: 2.1 time: 0.206822 Aug 30 00:56:58.602963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 85/171] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:58 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:59.276023 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:59.276602 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:59.283082 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:59.283561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:59.283985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:59.284669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:59.285112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:59.285524 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:59.427539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:59.436905 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dc9d05b5-3dd7-4e31-ba51-aa6831912160 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.164971 Aug 30 00:56:59.437489 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 87/172] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:59 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:56:59.623109 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:56:59.623864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:56:59.630044 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:59.630632 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:59.630945 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:59.632050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:56:59.632611 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:56:59.633066 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:56:59.790545 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:56:59.804627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-86b871e6-75d1-4f77-b0df-3866db6f3330 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1497 microversion: 2.1 time: 0.185704 Aug 30 00:56:59.805236 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 86/173] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:56:59 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:00.462137 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:00.462744 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:00.473231 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:00.473895 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:00.474480 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:00.475424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:00.476299 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:00.476945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:00.491322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:00.492132 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:00.499269 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:00.499860 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:00.500293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:00.501005 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:00.501450 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:00.501864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:00.530848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:57:00.624442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-441224b4-f552-467b-b882-7870c3cce1e8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 204 len: 0 microversion: 2.1 time: 0.136028 Aug 30 00:57:00.625658 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 87/174] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 00:57:00 2022] DELETE /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:57:00.638960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:00.639975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:00.649731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:00.650225 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:00.650661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:00.651477 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:00.651960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:00.652446 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:00.674482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:00.683295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-731d9d58-01c9-4a36-84d5-2c23de40ad5c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.228339 Aug 30 00:57:00.683872 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 88/175] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:00 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:00.805075 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:00.814587 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6cc41ced-68b7-4fba-8d75-5bc442de7576 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1503 microversion: 2.1 time: 0.183226 Aug 30 00:57:00.815765 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 88/176] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:00 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:01.705791 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:01.706369 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:01.713646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:01.714159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:01.714592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:01.715314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:01.715762 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:01.716180 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:01.837914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:01.838533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:01.844837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:01.845308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:01.845731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:01.846409 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:01.846820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:01.847257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:01.854426 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:01.871676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f4ffb6ca-ce77-47d0-9d2e-9286e602b239 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.170050 Aug 30 00:57:01.872258 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 89/177] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:01 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:02.007027 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:02.015150 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-668a5fa6-3ea4-4b6b-a821-1f9f014bfbfa tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1503 microversion: 2.1 time: 0.181204 Aug 30 00:57:02.015691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 89/178] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:01 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:02.893408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:02.893983 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:02.900679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:02.901159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:02.901596 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:02.902279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:02.902763 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:02.903224 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:03.036823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:03.037412 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:03.043850 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:03.044117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:03.044809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:03.045241 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:03.045940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:03.046388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:03.046801 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:03.051867 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4a2ed781-50a7-4093-8849-100a6487bb2d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.162428 Aug 30 00:57:03.052450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 90/179] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:02 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:03.066434 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:03.185171 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:03.196393 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6483dbb9-ee53-4eec-ae65-86df07d8db8a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1503 microversion: 2.1 time: 0.163685 Aug 30 00:57:03.196934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 90/180] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:03 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:04.073286 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:04.073886 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:04.080591 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:04.081088 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:04.081545 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:04.082212 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:04.082669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:04.083114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:04.101997 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:04.217623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:04.218224 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:04.218596 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:04.224713 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:04.225187 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:04.225607 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:04.226456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:04.226708 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ea13a436-136d-4d18-b974-9afbf69c5510 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.157598 Aug 30 00:57:04.226898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:04.227334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:04.227438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 91/181] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:04 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:04.380632 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:04.389407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ace37a72-aa51-46a4-a2ab-3f9932dc577a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1503 microversion: 2.1 time: 0.175613 Aug 30 00:57:04.389981 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 91/182] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:04 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:05.248258 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:05.248867 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:05.255499 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:05.255991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:05.256416 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:05.257123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:05.258155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:05.258584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:05.394291 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:05.402805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-384729e5-19a5-4b40-bbfb-1fbee7d62dc5 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.158521 Aug 30 00:57:05.403414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 92/183] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:05 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:05.409745 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:05.410488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:05.417177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:05.417315 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:05.417806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:05.418466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:05.419156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:05.419550 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:05.548813 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:05.556952 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c441a664-f61e-4f68-82fb-296e12d72479 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1503 microversion: 2.1 time: 0.151145 Aug 30 00:57:05.557561 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 92/184] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:05 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:06.425895 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:06.426507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:06.436140 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:06.436617 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:06.437046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:06.438396 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:06.438846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:06.439350 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:06.577002 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:06.578131 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:06.578736 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:06.585076 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:06.585581 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-36936e47-f390-4663-9d56-ce98225a72a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.163363 Aug 30 00:57:06.585723 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:06.586070 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:06.586502 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 93/185] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:06 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:06.586757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:06.587317 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:06.587742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:06.728500 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:06.737446 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d0a51265-cad7-433e-bc4a-31fb11171268 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1503 microversion: 2.1 time: 0.163075 Aug 30 00:57:06.738343 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 93/186] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:06 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:07.226101 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-ea9d64ca-c69a-4eb0-becd-5bdfba2ea7a2 req-da12eb63-24bc-4d94-bff8-93eb5956677d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30ab130-80b9-483c-bf13-f7ad54a3eb06", "name": "network-vif-deleted", "tag": "8d260501-cebd-4e84-8c1d-b67929828736"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:07.236302 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ea9d64ca-c69a-4eb0-becd-5bdfba2ea7a2 req-da12eb63-24bc-4d94-bff8-93eb5956677d service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:07.237375 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ea9d64ca-c69a-4eb0-becd-5bdfba2ea7a2 req-da12eb63-24bc-4d94-bff8-93eb5956677d service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:07.238031 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ea9d64ca-c69a-4eb0-becd-5bdfba2ea7a2 req-da12eb63-24bc-4d94-bff8-93eb5956677d service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:07.250683 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-ea9d64ca-c69a-4eb0-becd-5bdfba2ea7a2 req-da12eb63-24bc-4d94-bff8-93eb5956677d service nova] Creating event network-vif-deleted:8d260501-cebd-4e84-8c1d-b67929828736 for instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 on hv-cinder-81574 Aug 30 00:57:07.256475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-ea9d64ca-c69a-4eb0-becd-5bdfba2ea7a2 req-da12eb63-24bc-4d94-bff8-93eb5956677d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033781 Aug 30 00:57:07.256988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 94/187] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:57:07.607242 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:07.608750 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:07.617118 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:07.617941 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:07.618585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:07.619792 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:07.620467 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:07.620821 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:07.762060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:07.763416 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:07.777963 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:07.779569 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:07.782643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:07.784451 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:07.785251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:07.785788 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:07.799585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:07.808146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-da81a690-83a3-4fae-b864-56169a74b781 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.204798 Aug 30 00:57:07.811040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 94/188] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:07 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:07.835304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:07.836068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:07.836941 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:07.837414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lazy-loading 'fault' on Instance uuid a30ab130-80b9-483c-bf13-f7ad54a3eb06 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:57:07.886433 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:07.894196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c78a8523-9312-48a1-8652-ceb22d04985d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 200 len: 1304 microversion: 2.1 time: 0.138448 Aug 30 00:57:07.894933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 95/189] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:07 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:08.831909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:08.833083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:08.841125 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:08.842273 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:08.843172 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:08.843935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:08.844463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:08.844891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:08.920331 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:08.921025 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: a30ab130-80b9-483c-bf13-f7ad54a3eb06] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:08.928588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:08.929434 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:08.930029 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:08.930810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:08.931420 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:08.931970 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:08.948523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] HTTP exception thrown: Instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 could not be found. Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Request method failure captured: Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 HTTP/1.1 Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWBJUhzpBMh58vISBEUIXyfcQBNgp1NRAFqY_f1VeM8KZTGIe13oxvjAmFwBGH-C8ER6_g5vYA_DW--ge16ZEiMQf1yGolZF3nCwIdEtN-Kh2KRz23dpAPBlacaC71Cvu6ILTnfBOiBj1tnxAftV4XxPUyd_-wUAHFs4vr-8-4yBwEg Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 5b70056e81304145a833c88ea096e76d Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesActionsTest-1766937001 Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 00:57:08.950218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5b70056e81304145a833c88ea096e76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5b70056e81304145a833c88ea096e76d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b70056e81304145a833c88ea096e76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b70056e81304145a833c88ea096e76d"}]}] Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesActionsTest-1766937001 Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 5b70056e81304145a833c88ea096e76d Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesActionsTest-1766937001 Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesActionsTest-1766937001-project Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 309da81b8e13455a836e0c8435ed6b06 Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesActionsTest-1766937001-project Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 could not be found. Aug 30 00:57:08.951739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'a30ab130-80b9-483c-bf13-f7ad54a3eb06'} Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 could not be found. Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:57:08.952578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 could not be found. Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 could not be found. Aug 30 00:57:08.953942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 00:57:08.955494 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Returning 404 to user: Instance a30ab130-80b9-483c-bf13-f7ad54a3eb06 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:57:08.955494 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c9d9213a-3809-4f66-90ae-cb0857f45893 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06" status: 404 len: 111 microversion: 2.1 time: 0.038784 Aug 30 00:57:08.955494 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 96/190] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:08 2022] GET /compute/v2.1/servers/a30ab130-80b9-483c-bf13-f7ad54a3eb06 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:57:09.018952 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:09.029172 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e1ac8cbb-46bc-4bb8-a528-9b9a3d5dd120 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.201086 Aug 30 00:57:09.037177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 95/191] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:08 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:09.092145 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1407668443", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "networks": [{"uuid": "390f925d-047e-4666-8d10-c80e4334b0c3"}]}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:09.149839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] validate_networks() for [('390f925d-047e-4666-8d10-c80e4334b0c3', None, None, None, None, None)] {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:57:09.511669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:57:09.512080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:57:09.512680 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:57:09.513139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:57:09.513540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:57:09.523597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:09.524067 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:09.524491 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:09.525196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:09.525667 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:09.526074 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:09.542559 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Getting quotas for project 5b70056e81304145a833c88ea096e76d. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:57:09.546468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Getting quotas for user 309da81b8e13455a836e0c8435ed6b06 and project 5b70056e81304145a833c88ea096e76d. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:57:09.558259 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:57:09.560698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:57:09.610982 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a61cf03a-e6f8-4cd1-88a2-a09c0075c11d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522548 Aug 30 00:57:09.611646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 97/192] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:57:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:57:09.622973 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cdbda712-172d-47bd-845a-9e61b24e8d72 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:09.623595 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-cdbda712-172d-47bd-845a-9e61b24e8d72 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:09.680685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-cdbda712-172d-47bd-845a-9e61b24e8d72 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:09.687935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-cdbda712-172d-47bd-845a-9e61b24e8d72 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1214 microversion: 2.1 time: 0.069017 Aug 30 00:57:09.688590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 96/193] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:09 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:10.050604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:10.051233 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:10.057836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:10.058314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:10.058743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:10.059477 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:10.059925 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:10.060329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:10.223989 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:10.232263 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cfa201b7-64f9-4334-a894-d1afd19ac16e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.186121 Aug 30 00:57:10.232817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 98/194] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:10 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:10.715249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:10.716150 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:10.726215 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:10.726907 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:10.727370 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:10.728061 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:10.728509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:10.728928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:10.791749 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:10.806893 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0fbae1f5-14a5-40b3-a245-2a90584cb56d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1218 microversion: 2.1 time: 0.099008 Aug 30 00:57:10.807897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 97/195] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:10 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:11.254103 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:11.254721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:11.261564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:11.261922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:11.262344 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:11.263055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:11.263509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:11.263927 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:11.409588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:11.418459 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-67034a38-21c4-499d-af6f-d7abdb5dd0c7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.168164 Aug 30 00:57:11.418887 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 99/196] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:11 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:11.834368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:11.834911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:11.842078 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:11.842559 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:11.842983 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:11.843703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:11.844146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:11.844562 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:11.912591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:11.921028 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4ab3a22f-b86f-474f-847a-4abb10deda60 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1266 microversion: 2.1 time: 0.090513 Aug 30 00:57:11.921830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 98/197] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:11 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:12.440684 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:12.442210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:12.451870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:12.452737 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:12.453676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:12.454785 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:12.455403 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:12.455962 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:12.607910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:12.618271 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c644df9f-160e-488d-bd80-1d5e1a6e16ad tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.182546 Aug 30 00:57:12.618877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 100/198] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:12 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:12.945121 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:12.946707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:12.953294 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:12.954364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:12.955065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:12.956108 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:12.956766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:12.957272 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:13.131956 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:13.141509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-55cdff52-62a7-4900-b9a1-dbb6abe9700b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.201628 Aug 30 00:57:13.146744 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 99/199] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:12 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:13.392328 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-b3ca25c3-5fb3-4f83-bbd5-c1486a00a028 req-3594e3d4-9a7c-47f9-9441-8d12b92c761e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c", "tag": "df599212-8ee5-4705-bb65-1406ca598b66"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:13.417938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b3ca25c3-5fb3-4f83-bbd5-c1486a00a028 req-3594e3d4-9a7c-47f9-9441-8d12b92c761e service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:13.420046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b3ca25c3-5fb3-4f83-bbd5-c1486a00a028 req-3594e3d4-9a7c-47f9-9441-8d12b92c761e service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:13.420678 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b3ca25c3-5fb3-4f83-bbd5-c1486a00a028 req-3594e3d4-9a7c-47f9-9441-8d12b92c761e service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:13.453083 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-b3ca25c3-5fb3-4f83-bbd5-c1486a00a028 req-3594e3d4-9a7c-47f9-9441-8d12b92c761e service nova] Creating event network-changed:df599212-8ee5-4705-bb65-1406ca598b66 for instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c on hv-cinder-81574 Aug 30 00:57:13.459391 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-b3ca25c3-5fb3-4f83-bbd5-c1486a00a028 req-3594e3d4-9a7c-47f9-9441-8d12b92c761e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073534 Aug 30 00:57:13.460472 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 101/200] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:57:13.643521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:13.644251 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:13.653407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:13.654245 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:13.654865 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:13.655823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:13.656518 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:13.657124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:13.836778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:13.846478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-51b5827d-8be7-42dd-b78d-7fa57c0c1f97 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.209678 Aug 30 00:57:13.854294 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 100/201] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:13 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:14.162850 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:14.164988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:14.171909 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:14.172550 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:14.173114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:14.173972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:14.174709 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:14.175289 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:14.378014 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:14.386762 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ba0dd1cd-833f-4b4d-9385-8a3a8011547b tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.227867 Aug 30 00:57:14.387384 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 102/202] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:14 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:14.876113 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:14.879206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:14.888345 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:14.889125 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:14.889858 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:14.890732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:14.892053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:14.892774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:15.138709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:15.148568 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-756fca81-78db-40a0-aa9c-f3c52589ee03 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.278170 Aug 30 00:57:15.151379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 101/203] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:14 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:15.420882 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:15.423261 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:15.432900 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:15.433638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:15.434349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:15.435336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:15.436020 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:15.436686 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:15.891407 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:15.899062 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c9c095b1-ee5a-48ab-a08a-bf2d034bc9e1 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.493909 Aug 30 00:57:15.899676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 103/204] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:15 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:16.173224 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:16.174038 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:16.181492 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:16.182179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:16.182706 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:16.183565 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:16.184089 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:16.184687 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:16.342629 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:16.350749 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1c2b0b6a-d18b-4924-bb1b-837a785616dc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.183714 Aug 30 00:57:16.351758 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 102/205] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:16 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:16.920450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:16.920992 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:16.927647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:16.928113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:16.928550 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:16.929237 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:16.929667 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:16.930085 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:17.123035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:17.130866 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-924a3c35-b486-4333-9472-78293b8e7873 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.214578 Aug 30 00:57:17.131539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 104/206] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:16 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:17.372300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:17.372930 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:17.379112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:17.379592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:17.380014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:17.380700 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:17.381142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:17.381552 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:17.557716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:17.565600 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6d580d25-bd8a-4969-b46d-6672d1fad933 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.197323 Aug 30 00:57:17.566168 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 103/207] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:17 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:18.151223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:18.151898 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:18.155439 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:18.159119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:18.159609 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:18.160036 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:18.160969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:18.161325 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:18.161743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:18.294406 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:18.302229 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-22c27f67-6924-418e-9259-3bf7771c847e tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.154818 Aug 30 00:57:18.302795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 105/208] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:18 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:18.585909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:18.586506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:18.588549 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:18.593796 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:18.594276 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:18.594711 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:18.595615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:18.596063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:18.596477 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:18.733241 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:18.741965 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-15444d15-fc79-4866-bfab-66b79ecde790 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.159901 Aug 30 00:57:18.755072 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 104/209] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:18 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:19.330678 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:19.332071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:19.341694 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:19.342178 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:19.342599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:19.343319 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:19.343761 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:19.344177 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:19.483972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:19.492114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-aa680845-632c-4e9f-b8c2-f4ae0379a880 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.170959 Aug 30 00:57:19.492681 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 106/210] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:19 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:19.764529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:19.765162 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:19.767025 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:19.773361 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:19.774110 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:19.774617 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:19.775620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:19.776061 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:19.776494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:19.950155 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:19.959345 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9a04b739-1c5f-4dcc-a340-03dc33346f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.198489 Aug 30 00:57:19.960152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 105/211] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:19 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:20.513105 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:20.513811 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:20.515945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:20.516618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:20.523325 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:20.524012 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:20.525403 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:20.526202 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-81f46ca9-0b36-4b0e-b9f7-b0722ba2dcaf req-306a3ea6-2c6d-4dee-acf9-ac8f4a433109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c", "name": "network-vif-plugged", "status": "completed", "tag": "df599212-8ee5-4705-bb65-1406ca598b66"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:20.526623 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:20.527479 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:20.528284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:20.539250 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-81f46ca9-0b36-4b0e-b9f7-b0722ba2dcaf req-306a3ea6-2c6d-4dee-acf9-ac8f4a433109 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:20.539761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-81f46ca9-0b36-4b0e-b9f7-b0722ba2dcaf req-306a3ea6-2c6d-4dee-acf9-ac8f4a433109 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:20.540529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-81f46ca9-0b36-4b0e-b9f7-b0722ba2dcaf req-306a3ea6-2c6d-4dee-acf9-ac8f4a433109 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:20.552998 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-81f46ca9-0b36-4b0e-b9f7-b0722ba2dcaf req-306a3ea6-2c6d-4dee-acf9-ac8f4a433109 service nova] Creating event network-vif-plugged:df599212-8ee5-4705-bb65-1406ca598b66 for instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c on hv-cinder-81574 Aug 30 00:57:20.559031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-81f46ca9-0b36-4b0e-b9f7-b0722ba2dcaf req-306a3ea6-2c6d-4dee-acf9-ac8f4a433109 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037718 Aug 30 00:57:20.559668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 106/212] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:57:20.669309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:20.677233 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5de569ff-10d6-4640-b495-b497cd80ef0d tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.168272 Aug 30 00:57:20.677835 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 107/213] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:20 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:20.982526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:20.983311 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:20.989770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:20.990327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:20.990788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:20.991564 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:20.992106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:20.992578 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:21.136454 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:21.152300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ece186ee-efab-4b3c-89b7-b6d0de94a388 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.174196 Aug 30 00:57:21.153027 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 107/214] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:20 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:21.698486 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:21.699090 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:21.705900 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:21.706371 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:21.706797 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:21.707510 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:21.707953 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:21.708365 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:21.864726 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:21.875021 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b629376c-113a-433f-a386-b6a916617fe5 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.180463 Aug 30 00:57:21.875620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 108/215] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:21 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:22.173647 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:22.174379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:22.180660 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:22.181184 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:22.181623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:22.182307 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:22.182770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:22.183233 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:22.328565 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:22.332182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:22.337339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-450e4630-61e0-46cc-b992-c0852738adc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.167729 Aug 30 00:57:22.337991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 108/216] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:22 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:22.901183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:22.902242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:22.913915 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:22.914719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:22.915496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:22.916617 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:22.917094 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:22.917495 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:23.068638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:23.077281 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0f10f623-16ed-4370-9936-6f01d2d204a8 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.183662 Aug 30 00:57:23.079948 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 109/217] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:22 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:23.359615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:23.360269 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:23.366494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:23.366964 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:23.367418 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:23.368095 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:23.368535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:23.368943 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:23.511558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:23.519636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-42cfdae2-af1b-493d-8970-b18ea726e433 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1521 microversion: 2.1 time: 0.164432 Aug 30 00:57:23.520219 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 109/218] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:23 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:24.097751 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:24.098363 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:24.105372 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:24.105853 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:24.106281 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:24.106969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:24.107448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:24.107867 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:24.128320 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:24.264547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:24.275462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7a2f89a0-bc9a-4f76-b117-8bd476aca131 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.178690 Aug 30 00:57:24.275462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 110/219] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:24 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:24.541794 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:24.542569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:24.548903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:24.549370 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:24.549795 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:24.550471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:24.550911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:24.551407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:24.690124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:24.698558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-00b27372-4356-487d-b879-ec047e932311 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1501 microversion: 2.1 time: 0.160980 Aug 30 00:57:24.699157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 110/220] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:24 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:24.718629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:24.719289 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:24.725424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:24.725897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:24.726325 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:24.727016 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:24.727504 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:24.727898 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:24.864985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:24.873369 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f291b052-bf32-4a4a-b5d3-00d8eadba1b2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1514 microversion: 2.1 time: 0.158545 Aug 30 00:57:24.873934 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 111/221] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:24 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:25.294843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:25.295479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:25.301824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:25.302307 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:25.302738 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:25.303581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:25.304031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:25.304448 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:25.457189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:25.464848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d1dd200e-bfe7-4a29-bc93-286510672d69 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1314 microversion: 2.1 time: 0.174143 Aug 30 00:57:25.465415 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 111/222] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:25 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:26.277871 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:26.280815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:26.287597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:26.288067 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:26.288496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:26.289192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:26.289642 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:26.290059 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:26.313294 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lazy-loading 'flavor' on Instance uuid d56c98ec-9fce-4594-ae20-a22df2e99af4 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:57:26.439639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-88adfa9d-102c-4478-898c-3bd825ba9986 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4/action" status: 200 len: 32 microversion: 2.1 time: 0.165641 Aug 30 00:57:26.440490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 112/223] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:57:26 2022] POST /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:57:26.451203 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:26.451810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:26.458117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:26.458595 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:26.459062 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:26.459751 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:26.460192 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:26.460791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:26.486492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:26.487314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:26.494226 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:26.494918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:26.495641 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:26.496227 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:26.496736 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:26.497162 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:26.717184 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:26.725953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-60b0b289-9a4d-44fe-82d4-c3be49703292 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.278947 Aug 30 00:57:26.731094 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 112/224] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:26 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:26.735491 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:26.744752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e66cb070-a93c-40a9-aa29-e595e698440a tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1498 microversion: 2.1 time: 0.262600 Aug 30 00:57:26.745557 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 113/225] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:26 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1498 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:27.321676 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:27.322456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:27.328825 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:27.329404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:27.329879 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:27.330653 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:27.331202 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:27.331687 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:27.358303 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 00:57:27.469098 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-233d5e64-2a76-475d-b746-2f4a6fd0ecd2 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "DELETE /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 204 len: 0 microversion: 2.1 time: 0.150869 Aug 30 00:57:27.469829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 113/226] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 00:57:27 2022] DELETE /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:57:27.480038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:27.480795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:27.487972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:27.488696 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:27.489283 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:27.490134 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:27.490733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:27.491332 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:27.637694 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:27.652109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5d3484f9-5355-4fc6-9de8-046e14ffffb3 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1504 microversion: 2.1 time: 0.177862 Aug 30 00:57:27.652801 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 114/227] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:27 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:27.752282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:27.752963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:27.759438 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:27.760123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:27.760794 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:27.761396 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:27.761837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:27.762600 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:27.919026 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:27.929590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-75c3c1bb-ca4f-4566-8ecb-7c682e19f8ea tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.181380 Aug 30 00:57:27.930210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 114/228] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:27 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:28.673772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:28.674992 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:28.681528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:28.682004 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:28.682427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:28.683141 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:28.683583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:28.684218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:28.929633 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:28.951042 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:28.951663 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:28.955981 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6cf4d51d-d544-4194-9858-a3fb984dfa95 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1504 microversion: 2.1 time: 0.285878 Aug 30 00:57:28.956573 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 115/229] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:28 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1504 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:28.961340 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:28.962067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:28.962702 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:28.963681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:28.964457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:28.965053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:29.102714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:29.111047 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1aef8dd7-14d1-4731-b294-2a186b6fd2da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.164205 Aug 30 00:57:29.111621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 115/230] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:28 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:29.838073 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-850dc913-c45c-415a-842b-10f37e164512 req-89be6faa-e263-4ceb-9c68-2a046d63b23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c", "name": "network-vif-deleted", "tag": "df599212-8ee5-4705-bb65-1406ca598b66"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:29.856958 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-850dc913-c45c-415a-842b-10f37e164512 req-89be6faa-e263-4ceb-9c68-2a046d63b23b service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:29.857504 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-850dc913-c45c-415a-842b-10f37e164512 req-89be6faa-e263-4ceb-9c68-2a046d63b23b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:29.858286 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-850dc913-c45c-415a-842b-10f37e164512 req-89be6faa-e263-4ceb-9c68-2a046d63b23b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:29.979285 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:29.980835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:29.994225 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:29.996849 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:29.997952 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:30.002574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:30.004457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:30.005637 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:30.048509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-850dc913-c45c-415a-842b-10f37e164512 req-89be6faa-e263-4ceb-9c68-2a046d63b23b service nova] Creating event network-vif-deleted:df599212-8ee5-4705-bb65-1406ca598b66 for instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c on hv-cinder-81574 Aug 30 00:57:30.064252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-850dc913-c45c-415a-842b-10f37e164512 req-89be6faa-e263-4ceb-9c68-2a046d63b23b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229716 Aug 30 00:57:30.065459 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 116/231] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:57:30.103111 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:30.103598 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:30.104023 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:30.104465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lazy-loading 'fault' on Instance uuid 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:57:30.143185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:30.143625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:30.165183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:30.167995 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '309da81b8e13455a836e0c8435ed6b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b70056e81304145a833c88ea096e76d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:30.168242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:30.169337 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:30.171677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:30.192096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:30.192096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:30.192266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-795ab0f0-fe3c-4242-af8e-daa8bbdc9802 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 200 len: 1304 microversion: 2.1 time: 0.203635 Aug 30 00:57:30.192266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 116/232] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:29 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 1304 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:30.474856 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:30.496634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-90a912ac-8d51-4351-8388-70d8024108dd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.367114 Aug 30 00:57:30.497219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 117/233] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:30 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:31.203514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:31.205555 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] [instance: 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:31.214585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:31.215151 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:31.215797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:31.216608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:31.217073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:31.217480 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:31.238790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] HTTP exception thrown: Instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c could not be found. Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Request method failure captured: Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c HTTP/1.1 Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWBJUhzpBMh58vISBEUIXyfcQBNgp1NRAFqY_f1VeM8KZTGIe13oxvjAmFwBGH-C8ER6_g5vYA_DW--ge16ZEiMQf1yGolZF3nCwIdEtN-Kh2KRz23dpAPBlacaC71Cvu6ILTnfBOiBj1tnxAftV4XxPUyd_-wUAHFs4vr-8-4yBwEg Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 5b70056e81304145a833c88ea096e76d Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-VolumesActionsTest-1766937001 Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:57:31.241599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5b70056e81304145a833c88ea096e76d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5b70056e81304145a833c88ea096e76d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b70056e81304145a833c88ea096e76d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5b70056e81304145a833c88ea096e76d"}]}] Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-VolumesActionsTest-1766937001 Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 5b70056e81304145a833c88ea096e76d Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-VolumesActionsTest-1766937001 Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-VolumesActionsTest-1766937001-project Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 309da81b8e13455a836e0c8435ed6b06 Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-VolumesActionsTest-1766937001-project Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c could not be found. Aug 30 00:57:31.242915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c'} Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c could not be found. Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:57:31.243621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c could not be found. Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c could not be found. Aug 30 00:57:31.244778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:57:31.245773 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] Returning 404 to user: Instance 55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:57:31.245773 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d4f9916b-acd6-4f40-b3bb-318c6ae8d9d9 tempest-VolumesActionsTest-1766937001 tempest-VolumesActionsTest-1766937001-project] 10.222.0.17 "GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c" status: 404 len: 111 microversion: 2.1 time: 0.044232 Aug 30 00:57:31.245773 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 117/234] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:31 2022] GET /compute/v2.1/servers/55117f2f-d9cf-480d-8ae6-f8bbcacb6b7c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 00:57:31.519965 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:31.520589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:31.534522 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:31.534996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:31.535642 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:31.536527 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:31.536961 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:31.537593 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:32.255584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:32.267045 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0f3828eb-7989-464d-98d4-7199af5bd678 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.750854 Aug 30 00:57:32.281017 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 118/235] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:31 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:33.294382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:33.294890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:33.301274 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:33.301751 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:33.302386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:33.303108 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:33.303709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:33.304280 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:33.550055 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:33.559962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b56ab83b-2b8c-4bdd-a52f-8ebe91cea9b7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.269516 Aug 30 00:57:33.561102 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 118/236] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:33 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:34.582930 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:34.585222 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:34.595853 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:34.596487 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:34.596985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:34.597694 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:34.598149 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:34.598573 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:34.828919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:34.838389 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bf2938ee-01f0-42c2-91d1-56d8b5e0bed4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.260652 Aug 30 00:57:34.838965 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 119/237] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:34 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:35.860430 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:35.861196 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:35.868564 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:35.869389 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:35.870030 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:35.871626 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:35.872316 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:35.873395 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:36.205962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:36.216955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d0e73538-9014-4e4a-9a1f-ae19a5e54a61 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.360500 Aug 30 00:57:36.231309 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 119/238] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:35 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:37.238960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:37.239693 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:37.250206 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:37.250650 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:37.251163 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:37.255753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:37.256256 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:37.256688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:37.652381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:37.665996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c164f46c-97b4-4ffc-948e-059bb688da98 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.431579 Aug 30 00:57:37.668479 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 120/239] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:37 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:38.695495 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:38.696957 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:38.708842 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:38.721619 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:38.723732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:38.723732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:38.723732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:38.723990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:39.437257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:39.455405 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6c89eb92-3118-4882-9464-263be3e20ea3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.757361 Aug 30 00:57:39.456516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 120/240] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:38 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:40.499992 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:40.500618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:40.515948 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:40.516513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:40.516969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:40.517703 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:40.518168 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:40.518586 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:40.534860 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:40.538220 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:40.548891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:40.549940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:40.550588 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:40.552437 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:40.553358 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:40.554128 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:40.624790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-98411531-1e98-499d-a4bb-95e46b3d1b46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/ips" status: 200 len: 151 microversion: 2.20 time: 0.102869 Aug 30 00:57:40.625368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 121/241] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Aug 30 00:57:40 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:57:40.834460 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:40.834959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:40.842677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:40.853219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-2f504a11-f387-4770-a518-2962036585bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.368076 Aug 30 00:57:40.859170 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:40.859666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:40.860101 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:40.860812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:40.861260 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:40.869527 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:40.880453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 121/242] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:40 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:40.930498 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0a6fbdfd-6f23-4332-be36-01f9563fcf2a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/ips" status: 200 len: 144 microversion: 2.1 time: 0.100494 Aug 30 00:57:40.937397 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 122/243] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 00:57:40 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/ips => generated 144 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:57:41.892122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:41.893420 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:41.900632 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:41.903943 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:41.904706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:41.905640 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:41.906298 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:41.906697 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:42.095638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:42.104104 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-72711708-a9ef-491e-abee-5ca451f5ef81 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.215873 Aug 30 00:57:42.105166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 122/244] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:41 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:43.126399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:43.127685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:43.144789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:43.145277 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:43.145703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:43.146401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:43.163452 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:43.164004 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:43.590769 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:43.601944 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-86f56c44-5bec-4a72-ad5d-d0d6a8f57644 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.479671 Aug 30 00:57:43.612595 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 123/245] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:43 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:44.643655 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:44.644370 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:44.672546 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:44.673394 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:44.675980 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:44.676852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:44.679513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:44.681982 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:45.150660 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:45.160921 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b90d7d1c-52a1-4028-87c8-a830f0f03236 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.522757 Aug 30 00:57:45.180327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 123/246] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:44 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:45.198341 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1153633e-2512-4466-9df9-3c8a5aa9402f"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:45.202066 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:45.216838 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:45.219704 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:45.220146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:45.220884 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:45.224063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:45.225270 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:45.424747 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:45.616999 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:45.617986 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:45.630981 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:45.635722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:45.636216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:45.641592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:45.643646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:45.644300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:45.678597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lazy-loading 'flavor' on Instance uuid fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:57:45.808707 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:45.905222 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a95aff6a-7e11-4ea4-a84d-ff73fcca1c41 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713603 Aug 30 00:57:45.912570 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 124/247] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 00:57:45 2022] POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/os-volume_attachments => generated 194 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:57:46.192977 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:46.194075 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:46.229119 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:46.233762 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:46.237292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:46.242932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:46.245579 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:46.247714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:46.635263 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:46.648383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3ef76199-4f18-4f12-b210-6080a8d7cf2f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.460154 Aug 30 00:57:46.650012 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 125/248] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:46 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:47.671209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:47.673125 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:47.687429 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:47.688657 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:47.689443 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:47.690282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:47.691648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:47.695714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:48.075201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:48.097963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d82e6aba-ae86-4be4-be67-3e26b32593d8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.431886 Aug 30 00:57:48.098515 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 126/249] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:47 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:49.124073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:49.124983 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:49.132923 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:49.180296 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:49.181408 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:49.182295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:49.183237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:49.183986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:49.184592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:49.457118 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:49.465722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c3f58a63-c5f7-443d-a0bb-8f8e84772925 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.347337 Aug 30 00:57:49.480635 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 127/250] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:49 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:50.488596 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:50.490576 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:50.502321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:50.502931 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:50.503569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:50.504264 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:50.504857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:50.507303 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:50.789126 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:50.800390 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b8194a10-f7a0-4054-9390-26cef22bf21e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.316832 Aug 30 00:57:50.801914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 128/251] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:50 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:51.825187 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:51.826818 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:51.839474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:51.840308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:51.842097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:51.845401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:51.846037 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:51.847211 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:52.127257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:52.302106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8a06a6ac-2daa-4204-bd1b-1df5ac525bcb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.480225 Aug 30 00:57:52.303124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 129/252] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:51 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:53.112978 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fb6a5a57-9245-49be-be15-24430892a37f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:53.128380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fb6a5a57-9245-49be-be15-24430892a37f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:53.129004 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fb6a5a57-9245-49be-be15-24430892a37f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:53.129615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fb6a5a57-9245-49be-be15-24430892a37f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:53.315282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fb6a5a57-9245-49be-be15-24430892a37f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Going to try to stop instance {{(pid=144777) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 00:57:53.423856 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fb6a5a57-9245-49be-be15-24430892a37f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/action" status: 202 len: 0 microversion: 2.1 time: 0.315150 Aug 30 00:57:53.424711 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 130/253] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:57:53 2022] POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:57:53.447138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:53.448217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:53.461151 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:53.461730 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:53.462063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:53.462907 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:53.463538 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:53.464292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:53.718352 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:53.730407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-cb252f2d-43d7-4408-8fe3-b9d29a7983f3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.301921 Aug 30 00:57:53.731390 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 131/254] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:53 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:53.736529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:53.737129 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:53.750703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:53.753877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:53.754407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:53.755351 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:53.755812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:53.757398 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:53.992082 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:54.005727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a9eb6ea1-29a4-4ab6-958b-ae248e06f543 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.273061 Aug 30 00:57:54.006890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 132/255] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:53 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:54.751743 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:54.752511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:54.766937 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:54.782474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:54.783102 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:54.784114 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:54.784785 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:54.785446 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:55.099535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:55.108867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3a293fc8-9a8c-4914-b129-20d892458d1a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.361185 Aug 30 00:57:55.109449 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 133/256] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:54 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:55.114571 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:55.115473 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:55.128414 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:55.129317 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:55.130010 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:55.130982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:55.131833 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:55.132608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:55.322262 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:55.343103 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f1e90d51-3706-4bc7-b323-d3e31fcb0f6a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.232274 Aug 30 00:57:55.358670 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 134/257] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:55 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:55.370007 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8afe87b0-72c5-4d7d-83b4-d065b6b09e89 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Action: 'create', calling method: .version_select at 0x7f03a23d9a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1346908049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPrnXJg1LHXnwvHXgbtPcsc+sx7RET5d/d6JeQUF7e7pLY1QiAhk9AdVzj60AxneWOSPnRTLqfwy/TsssF3ek4OVxSftwS1HSPeEvTzI4GLIiD+i5+3p6t6w54lUHpACQ=="}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:55.393053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-8afe87b0-72c5-4d7d-83b4-d065b6b09e89 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Getting quotas for project 0113bd01866148a19268a30e6e76d4dc. Resources: {'key_pairs'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:57:55.397014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-8afe87b0-72c5-4d7d-83b4-d065b6b09e89 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Getting quotas for user b0905e37ac4643b793e1a8d32938479d and project 0113bd01866148a19268a30e6e76d4dc. Resources: {'key_pairs'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:57:55.453649 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8afe87b0-72c5-4d7d-83b4-d065b6b09e89 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.093968 Aug 30 00:57:55.464905 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 135/258] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 00:57:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:57:55.488628 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-154e238d-9749-4030-be73-4e45c597a8bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/action" status: 202 len: 0 microversion: 2.20 time: 9.875629 Aug 30 00:57:55.493096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 124/259] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 30 00:57:45 2022] POST /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/action => generated 0 bytes in 9881 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:57:55.506108 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:55.507185 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:55.524739 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:55.525343 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:55.525877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:55.526891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:55.527521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:55.528495 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:55.621066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-515503340", "imageRef": "3e83ab51-f619-4353-8070-ddfe394b4970", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1346908049", "networks": [{"uuid": "7e272d2f-7fe3-4adb-a93d-1cee4e37ccbf"}]}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:57:55.630362 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=39 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:55.697741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:55.708857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:55.710433 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:55.712227 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-910b3223-8c95-4cb6-a210-f2ec9a867034 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.215277 Aug 30 00:57:55.712883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 136/260] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:57:55 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:57:55.739414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] validate_networks() for [('7e272d2f-7fe3-4adb-a93d-1cee4e37ccbf', None, None, None, None, None)] {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:57:55.960218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=4,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:56.140095 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:56.140849 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:56.159529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:56.162087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:56.165774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:56.166837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:56.168192 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:56.168822 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:56.286662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:57:56.287124 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:57:56.287599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:57:56.288180 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:57:56.288749 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:57:56.299630 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:56.300390 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:56.302047 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:56.310135 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:56.310626 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:56.313399 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:56.342436 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Getting quotas for project 0113bd01866148a19268a30e6e76d4dc. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:57:56.347993 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Getting quotas for user b0905e37ac4643b793e1a8d32938479d and project 0113bd01866148a19268a30e6e76d4dc. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:57:56.364575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:57:56.369048 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3e83ab51-f619-4353-8070-ddfe394b4970',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:57:56.412596 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:56.423654 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2af1a2fd-8e9d-4ad4-ab8a-6b11735c9cb3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.288944 Aug 30 00:57:56.424584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 137/261] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:56 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:56.429389 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:56.430142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:56.438033 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:56.438727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:56.439863 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:56.441083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:56.441675 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:56.442243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:56.443562 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-41a5e067-b86c-4184-98b9-2ef28645e28b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824462 Aug 30 00:57:56.444240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 125/262] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:57:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:57:56.460673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1b0fa798-35a6-476d-891e-f7c57c4a86c8 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:56.461303 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1b0fa798-35a6-476d-891e-f7c57c4a86c8 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:56.543574 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1b0fa798-35a6-476d-891e-f7c57c4a86c8 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:56.550981 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1b0fa798-35a6-476d-891e-f7c57c4a86c8 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1258 microversion: 2.1 time: 0.099280 Aug 30 00:57:56.551608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 126/263] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:56 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1258 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:56.639567 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:56.647798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-747754a3-fd19-438b-b6c9-a2c5750392fb tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.221956 Aug 30 00:57:56.648551 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 138/264] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:56 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:56.739262 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:56.739885 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:56.746844 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:56.747386 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:56.747814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:56.748502 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:56.748950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:56.749364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:56.886566 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:56.896578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:56.898038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:56.899244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f42857f9-0006-4d78-b293-92031e7030e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.164029 Aug 30 00:57:56.899807 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 127/265] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:57:56 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:57:57.446288 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:57.446856 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:57.454595 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:57.455117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:57.455548 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:57.456243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:57.456694 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:57.457117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:57.572200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:57.572816 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:57.579709 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:57.580188 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:57.580617 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:57.581448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:57.581908 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:57.582327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:57.595310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:57.603368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f1cd23ea-8a3e-47ca-a28d-4aa18982c954 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.161021 Aug 30 00:57:57.603934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 139/266] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:57 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:57.651090 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:57.659136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9fc7a7f0-c8eb-4567-95ce-de65e46c5894 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1262 microversion: 2.1 time: 0.090962 Aug 30 00:57:57.659714 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 128/267] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:57 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:57.669934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:57.670683 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:57.676839 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:57.677303 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:57.677723 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:57.678708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:57.679190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:57.679604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:57.683947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:57:57.814605 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:57.823836 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-cd3b9e63-c973-4c1a-85c3-8aff62fdcda8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.158025 Aug 30 00:57:57.824411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 140/268] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:57 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:57.922591 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:57.923211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:57.930492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:57.930968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:57.931430 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:57.932102 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:57.932543 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:57.932958 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:58.070330 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:58.079209 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:58.080614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:58.081796 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ba14a944-9a38-4bee-b004-150525f79ff1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.163439 Aug 30 00:57:58.082338 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 129/269] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:57:57 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:57:58.625648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:58.626469 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:58.633674 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:58.634155 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:58.634594 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:58.635403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:58.635873 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:58.636295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:58.681333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:58.682459 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:58.702414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:58.702918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:58.703413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:58.704177 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:58.704702 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:58.705307 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:58.829307 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:58.839453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0886ec23-8124-406f-b4e9-ef8f20f07add tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1310 microversion: 2.1 time: 0.163238 Aug 30 00:57:58.854492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 130/270] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:58 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1310 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:57:58.860293 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:58.860987 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:58.866435 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:58.867811 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:58.868494 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:58.869123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:58.869885 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:58.870519 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:58.871024 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:58.874730 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ff20a311-b38f-4f63-84de-633782a1abc3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.253751 Aug 30 00:57:58.875332 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 141/271] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:58 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:59.020809 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:59.029658 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0fe2339d-b4b5-4da9-a5e8-166bfc28953d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.173597 Aug 30 00:57:59.030240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 131/272] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:58 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:57:59.105243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:59.105848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:59.112554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:59.113038 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:59.113468 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:59.114168 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:59.114649 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:59.115095 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:59.283292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:59.291803 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:59.293598 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:59.294774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2d6e1a9d-35e1-4680-b665-2a94a227801d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.193617 Aug 30 00:57:59.295678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 142/273] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:57:59 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:57:59.862329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:59.863116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:59.870216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:59.870843 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:59.871417 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:59.872452 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:59.873055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:59.873522 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:59.896028 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:57:59.897249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:57:59.904381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:59.905097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:59.905702 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:59.906942 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:57:59.907423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:57:59.908014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:57:59.945866 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:57:59.957706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3a60b525-0db7-4501-ab77-427742c1ea1b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1310 microversion: 2.1 time: 0.099810 Aug 30 00:57:59.958300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 132/274] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:59 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:00.053259 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:00.054079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:00.060921 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:00.061409 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:00.061836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:00.063112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:00.064019 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:00.064019 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:00.075600 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:00.084735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-84cf9978-4d7a-4f73-b7cc-9e7c73957255 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.192733 Aug 30 00:58:00.086208 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 143/275] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:57:59 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:00.216354 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:00.225375 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3f683e51-5593-4fae-915c-84ec239030d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.177571 Aug 30 00:58:00.225967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 133/276] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:00 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:00.318824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:00.319817 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:00.326418 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:00.327315 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:00.327897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:00.328798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:00.329704 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:00.330401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:00.475450 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:00.487210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:00.493110 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:00.495196 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1b7a3a26-27f6-49db-93ea-04590d375900 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.181141 Aug 30 00:58:00.496076 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 144/277] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:00 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:00.979271 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:00.979900 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:00.987169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:00.987764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:00.988199 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:00.989078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:00.989533 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:00.990108 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:01.053313 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:01.061923 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-baf7b8bb-eead-4b33-856f-2883183bd260 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1310 microversion: 2.1 time: 0.087189 Aug 30 00:58:01.062573 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 134/278] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:00 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:01.105727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:01.107079 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:01.114099 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:01.114755 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:01.115210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:01.116060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:01.116504 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:01.117101 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:01.246775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:01.247303 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:01.253902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:01.260973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:01.261515 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:01.264014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e2b5ef75-5950-441a-8a30-1184a7dfd139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.161846 Aug 30 00:58:01.265018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 145/279] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:01 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:01.273025 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:01.273934 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:01.274647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:01.275196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:01.440004 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:01.450230 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d47d3005-a15a-4c15-9908-08393de58140 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.207858 Aug 30 00:58:01.450821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 135/280] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:01 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:01.521007 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:01.521510 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:01.528165 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:01.528584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:01.528715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:01.529695 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:01.530145 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:01.530622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:01.692777 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:01.700953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:01.702462 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:01.703821 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f755ecbe-de55-4e61-bcca-fc4b0e34bd37 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.186739 Aug 30 00:58:01.704711 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 146/281] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:01 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:02.086577 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:02.088203 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:02.106476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:02.107590 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:02.108248 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:02.109356 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:02.112392 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:02.115200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:02.216231 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:02.225594 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8c35a755-6f39-4d4b-8330-41939d338f12 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1310 microversion: 2.1 time: 0.144033 Aug 30 00:58:02.226869 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 136/282] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:02 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1310 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:02.286789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:02.287726 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:02.296131 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:02.297144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:02.297909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:02.298640 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:02.299335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:02.299929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:02.478891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:02.479968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:02.517112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:02.531592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:02.532112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:02.532538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:02.533356 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:02.533827 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:02.534242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:02.535023 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-71c06479-7e9f-4c29-886f-0263b97f74a9 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.252511 Aug 30 00:58:02.535727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 147/283] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:02 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:02.707321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:02.717361 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fe38f725-1cb5-40b7-a91b-18dde5e1bfed tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.245300 Aug 30 00:58:02.717923 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 137/284] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:02 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:02.728828 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:02.729793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:02.740673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:02.741985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:02.742713 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:02.745453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:02.746401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:02.746937 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:02.900835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:02.911107 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:02.912816 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:02.914292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c3fb56d1-f427-46d1-b8c1-6731f4d65c7f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.191821 Aug 30 00:58:02.937046 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 148/285] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:02 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:03.252152 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:03.253448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:03.261192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:03.262028 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:03.262552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:03.263348 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:03.264050 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:03.264549 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:03.332291 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:03.342246 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fb597550-e5a7-4797-bc85-c3c83bf2d812 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1310 microversion: 2.1 time: 0.094439 Aug 30 00:58:03.343179 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 138/286] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:03 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:03.557321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:03.557932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:03.565763 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:03.568096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:03.568096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:03.568096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:03.568096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:03.568558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:03.712225 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:03.720533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d34ce033-110e-425e-958b-475e85ec7959 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.167105 Aug 30 00:58:03.721110 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 149/287] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:03 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:03.741363 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:03.742336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:03.749265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:03.749842 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:03.750390 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:03.751190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:03.751685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:03.752104 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:03.895302 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:03.904497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b3f67b63-7e1e-4f69-82c2-4e251c359ced tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.166969 Aug 30 00:58:03.905085 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 139/288] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:03 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:03.948086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:03.948693 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:03.957522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:03.958009 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:03.958439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:03.959163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:03.959796 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:03.960215 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:04.100218 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:04.108868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:04.110521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:04.111715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-557442c1-ae1c-46fa-8f88-5b649f066762 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.168837 Aug 30 00:58:04.112281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 150/289] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:03 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:04.364875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:04.365505 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:04.371960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:04.372434 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:04.372861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:04.373543 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:04.373985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:04.374400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:04.439099 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:04.447273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7d3b1d1a-a95b-494c-915d-7d965da756be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1328 microversion: 2.1 time: 0.086614 Aug 30 00:58:04.447846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 140/290] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:04 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:04.741990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:04.742592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:04.748883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:04.749470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:04.749773 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:04.750472 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:04.751299 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:04.751705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:04.947315 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:04.950698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:04.952721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:04.962679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:04.963200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:04.964984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:04.965996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:04.966848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-97e2a499-0d94-4a83-ab8f-12b5b4ccd256 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1500 microversion: 2.1 time: 0.228792 Aug 30 00:58:04.967973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:04.968104 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 151/291] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:04 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:04.971051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:04.988382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a52225b7-e67e-43aa-8cb9-5da46df3ca1e"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:04.991961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:04.998715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:04.999465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:05.000082 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:05.001101 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:05.001740 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:05.002379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:05.030191 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] HTTP exception thrown: Cannot 'attach_volume' instance d56c98ec-9fce-4594-ae20-a22df2e99af4 while it is in vm_state rescued Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Request method failure captured: Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: POST /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4/os-volume_attachments HTTP/1.1 Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 74 Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAZpwyg9_G7AFFXS_OTfo4jGYZHLvDJxY10FKJse4IyrqcRBKpZqfMUSTKUkO9jHIkzmwXlscxzwH_YQ7QqOLBbSVkYFjeKnXhqemnA7NlggBOZVflK3tbm569mlkgNPSL1T9so-ZOeqSMTQsTpNomQYJLwFCr4K_oT1abJ4reU11o Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 00:58:05.032465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a1cf0a235aa4669a9276c293a78f2eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}] Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 1d1c13089bd14d48ba637468182eee14 Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {"volumeAttachment": {"volumeId": "a52225b7-e67e-43aa-8cb9-5da46df3ca1e"}} Aug 30 00:58:05.033927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Cannot 'attach_volume' instance d56c98ec-9fce-4594-ae20-a22df2e99af4 while it is in vm_state rescued Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'server_id': 'd56c98ec-9fce-4594-ae20-a22df2e99af4', 'body': {'volumeAttachment': {'volumeId': 'a52225b7-e67e-43aa-8cb9-5da46df3ca1e'}}} Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d56c98ec-9fce-4594-ae20-a22df2e99af4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 00:58:05.034716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d56c98ec-9fce-4594-ae20-a22df2e99af4 while it is in vm_state rescued Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 00:58:05.036708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 00:58:05.038678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 00:58:05.038678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 00:58:05.038678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d56c98ec-9fce-4594-ae20-a22df2e99af4 while it is in vm_state rescued Aug 30 00:58:05.038678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 00:58:05.038678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Returning 409 to user: Cannot 'attach_volume' instance d56c98ec-9fce-4594-ae20-a22df2e99af4 while it is in vm_state rescued {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 00:58:05.038678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1f31cb54-2835-46e1-be0c-ebd355e4f6b8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050055 Aug 30 00:58:05.039470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 152/292] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 00:58:04 2022] POST /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 00:58:05.044356 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:05.044966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:05.052370 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:05.052940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:05.053451 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:05.054191 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:05.054806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:05.055440 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:05.163952 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e64222a1-1476-4597-b8fa-960b4a69b11e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4/action" status: 202 len: 0 microversion: 2.1 time: 0.122718 Aug 30 00:58:05.164786 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 153/293] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:58:05 2022] POST /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:58:05.181897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:05.183363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:05.194375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:05.195442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:05.196045 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:05.196989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:05.197628 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:05.198188 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:05.229662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:05.247449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-206c5516-420d-48f8-b22c-680bfa99f8ef tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.313558 Aug 30 00:58:05.254810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 141/294] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:04 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:05.267249 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:05.271331 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:05.285080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:05.285609 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:05.287128 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:05.288307 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:05.288970 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:05.290109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:05.405930 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=4 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:06.002255 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:06.020852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-78340e9a-93a4-4c8c-87bd-d30ed3139917 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.762789 Aug 30 00:58:06.021795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 142/295] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:05 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:06.026275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:06.026878 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:06.034204 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:06.034980 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:06.035679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:06.036818 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:06.037558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:06.040737 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:06.044257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:06.079571 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:06.089724 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:06.091511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:06.093173 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-47e819bc-88dd-4b99-bda0-b9934d9faf92 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.927318 Aug 30 00:58:06.103765 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 154/296] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:05 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:06.271426 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:06.272348 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:06.279496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:06.280270 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:06.282827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:06.283763 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:06.289627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:06.290298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:06.294567 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:06.305046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c95f0420-296f-4787-80eb-2a80a6e55f0a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.282177 Aug 30 00:58:06.308611 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 143/297] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:06 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:06.622287 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:06.633587 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f9b68ba2-39d8-47c1-beeb-9ab56c782e75 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.367191 Aug 30 00:58:06.654209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 155/298] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:06 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:06.711278 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-6325a21c-c6d1-418c-a878-9c1fa7735f3d req-7c3a49a2-91e9-4396-9900-7fb0655415fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c0d07e-f0f7-4abf-b406-39e4c0870f54", "tag": "94520acc-41df-40eb-bec9-b1c1e5e125c5"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:06.736202 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:06.742042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=8 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:06.772372 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-6325a21c-c6d1-418c-a878-9c1fa7735f3d req-7c3a49a2-91e9-4396-9900-7fb0655415fb service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:06.773071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-6325a21c-c6d1-418c-a878-9c1fa7735f3d req-7c3a49a2-91e9-4396-9900-7fb0655415fb service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:06.773575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-6325a21c-c6d1-418c-a878-9c1fa7735f3d req-7c3a49a2-91e9-4396-9900-7fb0655415fb service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:06.800573 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-6325a21c-c6d1-418c-a878-9c1fa7735f3d req-7c3a49a2-91e9-4396-9900-7fb0655415fb service nova] Creating event network-changed:94520acc-41df-40eb-bec9-b1c1e5e125c5 for instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 on hv-cinder-81574 Aug 30 00:58:06.821039 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-6325a21c-c6d1-418c-a878-9c1fa7735f3d req-7c3a49a2-91e9-4396-9900-7fb0655415fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114201 Aug 30 00:58:06.821708 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 144/299] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:07.043053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:07.043665 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:07.071192 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:07.071705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:07.072291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:07.073662 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:07.074131 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:07.074566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:07.107325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:07.148040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:07.149998 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:07.158859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:07.159772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:07.160442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:07.161339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:07.162022 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:07.162661 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:07.388793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:07.399251 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-223849c8-f84e-48d5-b77e-3c515efe9021 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.360931 Aug 30 00:58:07.408438 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 156/300] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:07 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:07.424194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:07.425321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:07.441009 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:07.445265 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:07.446154 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:07.447105 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:07.449264 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:07.456092 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:07.466824 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:07.493545 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:07.495271 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:07.497805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a97b1458-3105-46a7-8c1f-088d3ad91307 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.363579 Aug 30 00:58:07.497805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 145/301] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:07 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:07.648413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:07.661505 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d7cb8ef1-1bed-444f-b5e9-a842197cdca3 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.251541 Aug 30 00:58:07.662245 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:07.662916 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:07.674204 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:07.675758 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 157/302] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:07 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:07.679204 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:07.679821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:07.680672 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:07.681241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:07.681764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:07.857321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:07.859905 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-aab1ee5f-1e72-439d-95c4-5db9d7dcb76c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.201686 Aug 30 00:58:07.867742 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 146/303] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:07 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:08.435334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:08.437011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:08.446068 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:08.446946 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:08.447551 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:08.449675 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:08.450639 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:08.451106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:08.522397 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:08.523657 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:08.532995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:08.533769 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:08.534378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:08.535431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:08.536072 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:08.536960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:08.708303 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:08.717497 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d25efac9-a0e3-4328-83dd-4ac40e547c77 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.287261 Aug 30 00:58:08.727851 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 158/304] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:08 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:08.737842 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:08.738543 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:08.745042 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:08.745956 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:08.746585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:08.747735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:08.748543 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:08.749902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:08.860250 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:08.872599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:08.874163 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:08.875738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c7b8120b-5c7e-483e-a613-62cf3983e2a6 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.357439 Aug 30 00:58:08.877155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 147/305] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:08 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:08.884419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:08.885465 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:08.896096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:08.896815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:08.897485 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:08.898404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:08.899092 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:08.899722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:09.032394 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:09.041520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c39f2e43-3d0f-4bd1-952b-0078df21a7cb tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.308500 Aug 30 00:58:09.042087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 159/306] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:08 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:09.119496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:09.128229 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d9840b01-aee5-4957-b983-8b91cd144bb8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.249861 Aug 30 00:58:09.128904 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 148/307] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:08 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:09.742279 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:09.745474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:09.757219 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:09.757770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:09.758422 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:09.759151 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:09.759595 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:09.760171 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:09.910442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:09.911528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:09.920047 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:09.920995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:09.922954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:09.931331 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:09.934252 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:09.934764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:09.935810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:09.957764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-14da76b6-bb84-4cbc-862b-3c766cb746a3 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.218899 Aug 30 00:58:09.961168 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 160/308] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:09 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:10.068034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:10.069079 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:10.089434 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:10.090240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:10.090954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:10.092086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:10.093559 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:10.094375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:10.116935 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:10.132143 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:10.133587 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:10.134753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ffe6caac-0947-453a-a16b-4eb7ac6c168d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.232049 Aug 30 00:58:10.139067 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 149/309] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:09 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:10.153825 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:10.154434 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:10.161190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:10.161676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:10.162426 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:10.163362 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:10.163815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:10.164236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:10.311024 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:10.322875 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0ebc63ab-3b14-49c4-9bbd-3fa7e06a402f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.259808 Aug 30 00:58:10.324312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 161/310] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:10 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:10.363662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:10.371897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-be425e05-81f3-4b24-80a0-97c0e3bd1117 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.223488 Aug 30 00:58:10.372452 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 150/311] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:10 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:10.988683 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:10.989470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:10.998177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:10.998653 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:10.999105 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:10.999813 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:11.000259 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:11.000995 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:11.160418 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:11.161864 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:11.172834 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:11.173191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:11.173991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:11.175057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:11.178192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:11.178685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:11.188334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:11.199809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-af884ac5-0772-47c1-baea-5fc418f168c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.216204 Aug 30 00:58:11.215517 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 162/312] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:10 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:11.346875 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:11.347867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:11.355636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:11.357185 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:11.357842 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:11.358791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:11.359485 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:11.360174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:11.382520 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:11.408759 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:11.412363 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:11.413579 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-744b70a2-79d6-4056-bd5a-2d0f071ac588 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.257787 Aug 30 00:58:11.416335 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 151/313] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:11 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:11.436981 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:11.437942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:11.445967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:11.446451 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:11.446922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:11.447884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:11.448484 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:11.449059 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:11.553381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:11.562293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-78b1d8cb-5df5-4826-b43e-ab1d4c0b7c8d tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.219882 Aug 30 00:58:11.562971 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 163/314] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:11 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:11.689387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:11.700470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-10d875ce-e71d-4001-99b6-5154fe2ab8a0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.267534 Aug 30 00:58:11.701404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 152/315] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:11 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:12.224700 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:12.225366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:12.231926 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:12.232436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:12.233124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:12.234631 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:12.235143 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:12.235560 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:12.401773 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:12.410514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-be0b012b-d36a-41e3-97b4-b8f858e2171b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.191111 Aug 30 00:58:12.420703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 164/316] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:12 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:12.445431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:12.446051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:12.452730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:12.453211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:12.454032 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:12.454929 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:12.455413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:12.455835 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:12.586719 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:12.587748 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:12.601053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:12.601551 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:12.605865 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:12.606979 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:12.607673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:12.608330 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:12.626675 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:12.639302 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:12.641716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:12.643803 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-03a88d84-ac02-49c1-87a2-72bbdc3561e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.204502 Aug 30 00:58:12.644902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 153/317] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:12 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:12.722454 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:12.723395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:12.734145 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:12.736429 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:12.740244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:12.741276 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:12.741917 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:12.742686 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:12.877341 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:12.886312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-67267f51-c1e2-4e37-8355-520382b1fc04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.305681 Aug 30 00:58:12.901143 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 165/318] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:12 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:13.080310 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:13.098211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-885ad4c8-47ac-4c86-824f-341d724a8f0a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.380139 Aug 30 00:58:13.099042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 154/319] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:12 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:13.441153 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:13.442418 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:13.454153 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:13.455194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:13.456061 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:13.457331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:13.458391 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:13.459206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:13.656808 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:13.665859 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f3298234-3eb3-402d-96a4-b5e1d61f4d23 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.232463 Aug 30 00:58:13.666387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:13.666959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 166/320] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:13 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:13.667087 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:13.673873 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:13.674450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:13.675089 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:13.675992 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:13.676600 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:13.677139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:13.870921 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:13.882105 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:13.883716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:13.886037 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b7ff01ac-b436-4346-bcd4-ccd9abc1ceeb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.223649 Aug 30 00:58:13.887073 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 155/321] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:13 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:13.912434 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:13.913290 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:13.921255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:13.921990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:13.922591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:13.923470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:13.924107 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:13.924710 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:14.112117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:14.123520 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:14.124120 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:14.125094 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-28edac43-cfe4-4107-aefe-3e0f00a83f4b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.216074 Aug 30 00:58:14.127549 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 167/322] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:13 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:14.140770 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:14.141364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:14.141877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:14.142592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:14.147722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:14.148379 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:14.423548 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:14.438287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4af69479-53e5-4557-8a42-019081dd4168 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.318392 Aug 30 00:58:14.456423 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 156/323] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:14 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:14.688521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:14.689949 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:14.698084 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:14.699047 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:14.699655 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:14.700432 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:14.700971 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:14.701461 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:14.877309 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:14.890232 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b000354e-afaf-4429-bb01-720a290fb582 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.206261 Aug 30 00:58:14.903634 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 168/324] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:14 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:14.912120 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:14.912874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:14.923187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:14.923672 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:14.924104 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:14.924865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:14.925479 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:14.925900 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:15.091121 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:15.102335 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:15.103822 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:15.104983 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f6715c8f-63ca-48ac-b9d9-f4304c413d6d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.198906 Aug 30 00:58:15.105780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 157/325] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:14 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:15.150973 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:15.151775 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:15.160515 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:15.160984 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:15.161407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:15.162091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:15.162533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:15.162959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:15.294326 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:15.302612 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-88e219e5-d3fc-4b26-9240-755686dd2120 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.155469 Aug 30 00:58:15.303221 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 169/326] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:15 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:15.470003 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:15.471046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:15.481513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:15.482381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:15.484608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:15.486443 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:15.487348 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:15.488022 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:15.673057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:15.697532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dd759f84-0517-4452-8841-bcd13c575be4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1721 microversion: 2.1 time: 0.236939 Aug 30 00:58:15.698801 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 158/327] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:15 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:15.931161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:15.932614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:15.943080 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:15.944077 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:15.944811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:15.945834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:15.946570 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:15.947361 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:16.124613 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:16.128714 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:16.130070 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:16.134818 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-78c0d7f4-aff1-4e08-a1db-ca94da948f74 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.208460 Aug 30 00:58:16.139051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 170/328] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:15 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:16.139210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:16.139210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:16.139210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:16.139210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:16.139489 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:16.139489 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:16.285599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:16.294795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:16.296460 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:16.297761 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6d2a0436-f294-47a9-b875-0a89572fac69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.173987 Aug 30 00:58:16.298413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 159/329] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:16 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:16.325197 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:16.325975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:16.332898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:16.333384 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:16.333880 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:16.334581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:16.335162 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:16.335578 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:16.489332 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:16.497514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4d7eb66a-aabc-40c2-b0dc-44239e786355 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.176463 Aug 30 00:58:16.498130 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 171/330] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:16 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:16.719604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:16.720646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:16.727198 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:16.727756 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:16.728419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:16.729187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:16.729828 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:16.730317 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:16.763635 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:17.031598 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:17.040985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-2e85a785-6ca8-4a51-82da-37790c37c2ab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1698 microversion: 2.1 time: 0.325165 Aug 30 00:58:17.055463 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 160/331] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:16 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1698 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:17.062609 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0f581486-7b6c-4227-aaec-0cd334244a5b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:17.070398 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:17.072735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f581486-7b6c-4227-aaec-0cd334244a5b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.073413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f581486-7b6c-4227-aaec-0cd334244a5b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.073996 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f581486-7b6c-4227-aaec-0cd334244a5b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:17.126531 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0f581486-7b6c-4227-aaec-0cd334244a5b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Going to try to start instance {{(pid=144777) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 00:58:17.134021 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:17.156254 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:17.156930 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:17.169408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.170556 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.171507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:17.172555 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.173025 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.173438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:17.219587 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0f581486-7b6c-4227-aaec-0cd334244a5b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/action" status: 202 len: 0 microversion: 2.1 time: 0.160405 Aug 30 00:58:17.221051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 172/332] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:58:17 2022] POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:58:17.232763 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:17.234217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:17.245899 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.246750 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.247427 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:17.248312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.249337 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.249811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:17.539320 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:17.555740 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-28abffce-6e05-4e86-952c-6d28880d5471 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.403430 Aug 30 00:58:17.556863 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 161/333] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:17 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:17.563196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:17.564194 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:17.584215 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.585086 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.585726 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:17.586756 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.587363 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.594125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:17.745111 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:17.755589 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d7cf9522-1319-4152-aade-d1b16abb34fd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1707 microversion: 2.1 time: 0.530483 Aug 30 00:58:17.770271 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 173/334] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:17 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1707 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:17.775574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:17.776418 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:17.789850 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.790326 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.791123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:17.791974 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:17.792589 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:17.793221 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:18.045951 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:18.055536 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:18.057167 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:18.058422 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fe1c847f-0fdb-4c79-918e-074e7babae0d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.500409 Aug 30 00:58:18.081898 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 162/335] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:17 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:18.132856 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:18.142264 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8c3bb8ba-28cb-43f8-b9bb-afc86538ac4a tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.370358 Aug 30 00:58:18.143346 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 174/336] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:17 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:18.582225 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:18.583160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:18.590730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:18.591967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:18.592734 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:18.593858 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:18.595438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:18.596295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:18.777247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:18.777851 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:18.794368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:18.795273 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:18.795976 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:18.796841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:18.797504 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:18.798258 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:19.156644 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:19.166662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d061b02a-4495-43c5-a35f-c8871e45e3e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1508 microversion: 2.1 time: 0.589596 Aug 30 00:58:19.169179 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 163/337] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:18 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1508 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:19.175032 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:19.175738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:19.184523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:19.185273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:19.185902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:19.186617 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:19.187114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:19.187542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:19.190612 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:19.201574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-34b4dbec-5ec6-45f6-884f-3cea60b58df7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1707 microversion: 2.1 time: 0.428670 Aug 30 00:58:19.202696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 175/338] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:18 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1707 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:19.207714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:19.208621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:19.215152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:19.215926 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:19.216642 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:19.217553 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:19.218205 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:19.218827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:19.492285 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:19.499743 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:19.500507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:19.502405 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:19.503864 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8fe12b02-6a4b-4dae-aaed-e131960c5943 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.333500 Aug 30 00:58:19.504665 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 164/339] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:19 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:19.509316 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-63968e55-5232-4bc5-a827-6e19c2596c7c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.305181 Aug 30 00:58:19.510011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 176/340] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:19 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:20.194973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:20.196295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:20.203078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:20.204765 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:20.205408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:20.205998 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:20.207542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:20.208155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:20.208731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:20.224883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:20.226195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:20.234989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:20.236486 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:20.237126 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:20.238264 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:20.238941 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:20.239735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:20.690598 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:20.697313 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:20.701509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fd785289-9a35-491e-a281-a1504b394169 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1514 microversion: 2.1 time: 0.511493 Aug 30 00:58:20.702499 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 165/341] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:20 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1514 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:20.709389 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:20.710351 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:20.717914 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:20.719431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:20.720190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:20.721120 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:20.722223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:20.733048 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1eee97e5-c35d-4c9b-8a11-2077ada0697d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1707 microversion: 2.1 time: 0.512240 Aug 30 00:58:20.733253 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:20.736482 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 177/342] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:20 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1707 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:20.747447 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:20.750889 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:20.764238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:20.764890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:20.765334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:20.766530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:20.773253 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:20.773777 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:21.029169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:21.045256 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:21.046684 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:21.054013 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f887d2fc-ea09-4a5f-ac0d-ce62869e6e8e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.350058 Aug 30 00:58:21.054758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 166/343] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:20 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:21.065390 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:21.076948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8e4ab153-49ad-4247-bcc5-d0c4e966cd41 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.339144 Aug 30 00:58:21.077607 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 178/344] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:20 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:21.764133 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:21.764955 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:21.771989 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:21.772474 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:21.772899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:21.773608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:21.774049 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:21.774467 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:22.053645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:22.063894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0ce8277d-a08b-43bc-bb78-0a26d4b7c6c6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1707 microversion: 2.1 time: 0.311188 Aug 30 00:58:22.064562 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 167/345] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:21 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1707 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:22.085157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:22.089045 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:22.102036 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:22.103373 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:22.118188 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:22.118680 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:22.119719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:22.119924 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:22.120399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:22.121342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:22.121862 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:22.122805 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:22.123450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:22.124034 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:22.124757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:22.126752 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:22.489050 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:22.506314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-28b17001-af77-4dd1-b4a9-c169fe45723f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.409983 Aug 30 00:58:22.540392 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 168/346] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:22 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:22.547089 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7c89b9e3-f2a0-42f9-8693-92be180fa4e7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'create', calling method: .version_select at 0x7f03a22f5040>, body: {"keypair": {"name": "tempest-keypair-459089252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzKkLfcFMdynB6DciHWuKhVLBk8gvJ58yoPBLtPer9QG9wzAtNSpi7F1sPyEIuffZGg4BEparGFvNwMe7khAJZw6Co8vx1a7xytIEXBkINIfPzcMhMYsppEJfNTJ2QT7g=="}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:22.583757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-7c89b9e3-f2a0-42f9-8693-92be180fa4e7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Getting quotas for project 9a1cf0a235aa4669a9276c293a78f2eb. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:58:22.600419 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:22.600698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-7c89b9e3-f2a0-42f9-8693-92be180fa4e7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Getting quotas for user 1d1c13089bd14d48ba637468182eee14 and project 9a1cf0a235aa4669a9276c293a78f2eb. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:58:22.616935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:22.620972 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:22.624452 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9854cad2-b163-4a1d-9d7f-41574b8bef68 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1743 microversion: 2.20 time: 0.542449 Aug 30 00:58:22.627427 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 179/347] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:22 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1743 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:22.651747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7c89b9e3-f2a0-42f9-8693-92be180fa4e7 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108483 Aug 30 00:58:22.665588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 169/348] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 00:58:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:23.097685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:23.098306 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:23.108869 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:23.112195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:23.115996 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:23.117253 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:23.118007 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:23.118580 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:23.414386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:23.428574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-14769761-6e72-4199-8f75-e6828c5f8ecd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1711 microversion: 2.1 time: 0.336731 Aug 30 00:58:23.429589 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 180/349] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:23 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1711 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:23.548704 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:23.550047 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:23.558610 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:23.562321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:23.563223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:23.564586 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:23.566404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:23.570532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:23.659761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:23.662474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:23.679567 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:23.681533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:23.683028 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:23.684951 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:23.685436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:23.689709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:24.113860 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:24.127322 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1fe75b0e-88af-43e2-aa5e-51939314155b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.582073 Aug 30 00:58:24.129047 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 170/350] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:23 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:24.181927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:24.194292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:24.196198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:24.197620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-23419be5-c2c8-4390-a61e-f5e6ac6e8447 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1743 microversion: 2.20 time: 0.549395 Aug 30 00:58:24.213161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 181/351] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:23 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1743 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:25.153217 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:25.153758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:25.172722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:25.176044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:25.177698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:25.183089 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:25.186246 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:25.186693 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:25.224108 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:25.224701 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:25.236876 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:25.237747 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:25.240071 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:25.241053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:25.242962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:25.245338 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:26.775848 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:26.791304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e9491bcc-c875-4ded-aa7f-693761903b53 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 1.644167 Aug 30 00:58:26.809995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 171/352] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:25 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:26.817129 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-8a61c70f-65a3-40e9-8aea-04c9f4a256c0 req-55e7ca4d-bfee-495b-bd68-fdcdd875fbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c0d07e-f0f7-4abf-b406-39e4c0870f54", "name": "network-vif-plugged", "status": "completed", "tag": "94520acc-41df-40eb-bec9-b1c1e5e125c5"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:26.849382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-8a61c70f-65a3-40e9-8aea-04c9f4a256c0 req-55e7ca4d-bfee-495b-bd68-fdcdd875fbaf service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:26.851090 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-8a61c70f-65a3-40e9-8aea-04c9f4a256c0 req-55e7ca4d-bfee-495b-bd68-fdcdd875fbaf service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:26.853893 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-8a61c70f-65a3-40e9-8aea-04c9f4a256c0 req-55e7ca4d-bfee-495b-bd68-fdcdd875fbaf service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:26.882922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-8a61c70f-65a3-40e9-8aea-04c9f4a256c0 req-55e7ca4d-bfee-495b-bd68-fdcdd875fbaf service nova] Creating event network-vif-plugged:94520acc-41df-40eb-bec9-b1c1e5e125c5 for instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 on hv-cinder-81574 Aug 30 00:58:26.904903 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-8a61c70f-65a3-40e9-8aea-04c9f4a256c0 req-55e7ca4d-bfee-495b-bd68-fdcdd875fbaf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093301 Aug 30 00:58:26.905802 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 172/353] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:27.456660 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:27.466317 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:27.481424 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:27.494553 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-aaa34cda-4d62-48bd-9616-f19ec7823f75 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 2.272506 Aug 30 00:58:27.504576 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 182/354] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:25 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 2285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:27.615589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1421553973", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "770e41c2-a4c2-40d0-a91c-277558a93ee6"}], "security_groups": [{"name": "tempest-securitygroup--237161632"}], "key_name": "tempest-keypair-459089252", "user_data": "}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:27.818119 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:27.818723 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:27.840967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:27.841460 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:27.841892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:27.842622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:27.843086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:27.843511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:28.159884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] validate_networks() for [('770e41c2-a4c2-40d0-a91c-277558a93ee6', None, None, None, None, None)] {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:58:28.490455 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:28.506089 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-67106bbb-e062-4ce4-aa90-f57b8ce94c79 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.686176 Aug 30 00:58:28.525053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 183/355] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:27 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:28.548615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:28.549233 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:28.576209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:28.581411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:28.582721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:28.584045 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:28.585841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:28.586812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:29.247119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:58:29.248991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:58:29.249654 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:58:29.250273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:58:29.253502 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:58:29.269809 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:29.279416 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:29.280128 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:29.281160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:29.282625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:29.283311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:29.291207 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:29.306337 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:29.309184 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:29.315144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-32d1f4ea-e505-4364-987b-805c3b0c1917 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.784645 Aug 30 00:58:29.320785 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 184/356] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:28 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:29.322237 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Getting quotas for project 9a1cf0a235aa4669a9276c293a78f2eb. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:58:29.330440 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-39ea3bff-5d9d-4235-843c-41f7c1007d8e req-9c866b24-4aeb-4707-89de-126c87310368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7bbc0c-7d22-46e1-82f5-784e10ce23f3", "name": "network-vif-plugged", "status": "completed", "tag": "f8cd35a2-3f40-45d7-aeeb-e642ffc6e344"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:29.333926 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Getting quotas for user 1d1c13089bd14d48ba637468182eee14 and project 9a1cf0a235aa4669a9276c293a78f2eb. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:58:29.360020 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-39ea3bff-5d9d-4235-843c-41f7c1007d8e req-9c866b24-4aeb-4707-89de-126c87310368 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:29.360807 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-39ea3bff-5d9d-4235-843c-41f7c1007d8e req-9c866b24-4aeb-4707-89de-126c87310368 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:29.361405 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-39ea3bff-5d9d-4235-843c-41f7c1007d8e req-9c866b24-4aeb-4707-89de-126c87310368 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:29.377791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-39ea3bff-5d9d-4235-843c-41f7c1007d8e req-9c866b24-4aeb-4707-89de-126c87310368 service nova] Creating event network-vif-plugged:f8cd35a2-3f40-45d7-aeeb-e642ffc6e344 for instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 on hv-cinder-81574 Aug 30 00:58:29.394979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:58:29.395575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-39ea3bff-5d9d-4235-843c-41f7c1007d8e req-9c866b24-4aeb-4707-89de-126c87310368 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070804 Aug 30 00:58:29.397396 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 185/357] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:29.401270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:58:29.536483 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:29.537255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:29.537387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-605a439a-bdc1-49ef-9c61-f527421e8452 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.929909 Aug 30 00:58:29.543512 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 173/358] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:58:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:58:29.553747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-aafbaf24-b89f-4ef4-a691-965d0a18b4da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:29.556194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:29.557661 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-aafbaf24-b89f-4ef4-a691-965d0a18b4da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:29.559483 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:29.561947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:29.565849 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:29.569028 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:29.569644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:29.972396 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-aafbaf24-b89f-4ef4-a691-965d0a18b4da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:29.980419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-aafbaf24-b89f-4ef4-a691-965d0a18b4da tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1245 microversion: 2.1 time: 0.435135 Aug 30 00:58:29.981013 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 174/359] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:29 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1245 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:30.319606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:30.337918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a10454e8-f9a0-4bad-90af-2ebbdbf0281c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1358 microversion: 2.1 time: 0.799623 Aug 30 00:58:30.346153 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:30.347519 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:30.351559 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 186/360] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:29 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1358 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:30.361494 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:30.368057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:30.369302 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:30.374831 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:30.375862 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:30.376536 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:30.941789 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:30.953160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:30.969930 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:30.974244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bdb9c208-eb54-4299-919f-132bd537c0ac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.634336 Aug 30 00:58:30.981850 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 175/361] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:30 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:31.001884 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:31.003321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:31.018071 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:31.020122 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:31.023336 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:31.024841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:31.027657 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:31.030436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:31.309347 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:31.325419 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-911125d1-7b20-48e6-a1e6-a7f7e63ebd93 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1297 microversion: 2.1 time: 0.327159 Aug 30 00:58:31.340474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 187/362] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:30 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1297 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:31.375519 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:31.376134 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:31.424378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:31.425114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:31.428262 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:31.430002 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:31.430741 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:31.431404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:32.002826 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:32.003452 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:32.013942 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:32.014856 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:32.016705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:32.019847 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:32.022907 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:32.026484 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:32.684202 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:32.693606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cff44a93-fd15-4e45-9133-b16eb64c637b tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1549 microversion: 2.1 time: 1.321911 Aug 30 00:58:32.707758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 176/363] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:31 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1549 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:32.714739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:32.716584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:32.731975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:32.732799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:32.733448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:32.734782 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:32.735478 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:32.739830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:32.784442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:32.798206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:32.800372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:32.801876 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e0837d56-6510-4eb3-8b80-22d37d1853d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.803891 Aug 30 00:58:32.802749 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 188/364] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:31 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:32.854268 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:32.866400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b7addddc-6293-4c1c-9e30-f304bd540a4b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1303 microversion: 2.1 time: 0.171135 Aug 30 00:58:32.866976 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 177/365] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:32 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:32.886277 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:32.887178 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:32.901466 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:32.902421 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:32.903044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:32.905233 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:32.905854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:32.908824 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:33.110523 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-75e34313-bd63-4550-af59-bb14c3adb3c3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Action: 'create', calling method: .version_select at 0x7f03a2052ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1989786991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2pWWmBXvpsYuu1gNyPkjySZxl43Ki43rFjdES1lhEZKFkMWxF1oroq1IG22xv/59KDCt0PKEGB4FkYUj2WmtvX1YXfgUwxWIxkBxrRaWCQCv0nzH6ZuzKBuMQsL4t/4A=="}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:33.150746 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-75e34313-bd63-4550-af59-bb14c3adb3c3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Getting quotas for project 2b0736ff08ae4fa6be73ec678c98077f. Resources: {'key_pairs'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:58:33.164947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-75e34313-bd63-4550-af59-bb14c3adb3c3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Getting quotas for user 1558d42f4c7f437495af05d4c8c42e6e and project 2b0736ff08ae4fa6be73ec678c98077f. Resources: {'key_pairs'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:58:33.229523 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-75e34313-bd63-4550-af59-bb14c3adb3c3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.408979 Aug 30 00:58:33.230199 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 189/366] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 00:58:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:33.829261 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:33.833831 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:33.834452 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:33.839047 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e5d44d0b-a0c2-4609-b2d8-02f270c56514 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1549 microversion: 2.1 time: 0.970754 Aug 30 00:58:33.851783 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 178/367] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:32 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1549 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:33.852044 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:33.852376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:33.852824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:33.853568 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:33.854030 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:33.854456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:33.868576 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:33.875134 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:33.885812 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:33.887052 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Searching by: {'deleted': False, 'project_id': '0113bd01866148a19268a30e6e76d4dc'} {{(pid=144776) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 00:58:33.901794 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:33.906217 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:33.910947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:33.912092 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:33.912733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:33.913321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:34.137838 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.multi_cell_list [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=144776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 00:58:34.414705 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3a44aa88-dc04-493f-baff-2a01211987b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.543597 Aug 30 00:58:34.415933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 179/368] 10.222.0.17 () {58 vars in 1125 bytes} [Tue Aug 30 00:58:33 2022] GET /compute/v2.1/servers => generated 342 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:34.427615 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:34.428723 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:34.438979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:34.450249 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:34.451101 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:34.452352 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:34.453068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:34.454768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:34.482980 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:34.678516 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:34.688620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c66bd351-9fdc-4ea1-bb36-89bbd723afb6 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1303 microversion: 2.1 time: 0.270582 Aug 30 00:58:34.704960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 180/369] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:34 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1303 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:34.723320 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:34.724557 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:34.741275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:34.742962 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:34.744288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:34.744801 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:34.745361 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:34.746169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:34.825472 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:34.838275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:34.842668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:34.844145 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4d161041-a864-41af-a4c3-26679abcd6bc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 1.014285 Aug 30 00:58:34.845641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 190/370] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:33 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:35.281720 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:35.303746 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-65e6f74a-410f-4b64-b76e-47429a1c9b04 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1549 microversion: 2.1 time: 0.592722 Aug 30 00:58:35.304618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 181/371] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:34 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1549 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:35.722298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:35.723106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:35.752262 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:35.753204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:35.754088 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:35.755614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:35.756494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:35.757331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:35.871277 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:35.872109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:35.887352 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:35.888075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:35.888515 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:35.889801 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:35.890400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:35.891664 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:36.780456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:36.794835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b7b19c2b-0bfc-4c75-b26c-e3d13c4865f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 1.077477 Aug 30 00:58:36.796512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 191/372] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:35 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:36.864757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:36.882674 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:36.888192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:36.896813 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f90e97d3-91f5-4862-9c21-6f6c2756bf29 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 1.022055 Aug 30 00:58:36.911172 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 182/373] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:35 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:37.670148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21d88adb-a569-4f97-a848-c4281351d2a0"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:37.673703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:37.680933 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:37.681644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:37.682278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:37.683240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:37.684172 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:37.684790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:37.819118 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:37.819625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:37.830242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:37.830733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:37.831196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:37.831902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:37.832349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:37.832767 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:38.239843 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:38.251998 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-57e637cd-3428-4180-b08f-a9d393cb89ae tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.437076 Aug 30 00:58:38.253447 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 183/374] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:37 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:38.259750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:38.276136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:38.287613 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:38.288381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:38.288969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:38.289849 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:38.290448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:38.291027 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:38.628686 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:38.643515 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:38.646048 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:38.648100 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ea4db057-a2b9-4e8e-9b45-e7e1d390f288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.392179 Aug 30 00:58:38.648971 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 184/375] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:38 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:38.654879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-c8d453c5-e407-4810-991f-7ce73d93cfb0 req-6403a298-6a82-41e4-9e34-903fac9bbe53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac33e3d7-0988-43ef-be96-21ad64b2825a", "tag": "b9464aee-4ec1-4b42-9b48-87dd1b038f79"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:38.677717 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c8d453c5-e407-4810-991f-7ce73d93cfb0 req-6403a298-6a82-41e4-9e34-903fac9bbe53 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:38.678497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c8d453c5-e407-4810-991f-7ce73d93cfb0 req-6403a298-6a82-41e4-9e34-903fac9bbe53 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:38.678922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c8d453c5-e407-4810-991f-7ce73d93cfb0 req-6403a298-6a82-41e4-9e34-903fac9bbe53 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:38.704481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-c8d453c5-e407-4810-991f-7ce73d93cfb0 req-6403a298-6a82-41e4-9e34-903fac9bbe53 service nova] Creating event network-changed:b9464aee-4ec1-4b42-9b48-87dd1b038f79 for instance ac33e3d7-0988-43ef-be96-21ad64b2825a on hv-cinder-81574 Aug 30 00:58:38.711220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-c8d453c5-e407-4810-991f-7ce73d93cfb0 req-6403a298-6a82-41e4-9e34-903fac9bbe53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060794 Aug 30 00:58:38.712183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 185/376] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:39.277341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:39.278055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:39.287905 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:39.288637 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:39.289376 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:39.290413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:39.296403 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:39.297276 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:39.717492 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-59f32b1b-9749-44d8-a77f-0507b567bbd4 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "POST /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.051126 Aug 30 00:58:39.722166 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 192/377] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 00:58:37 2022] POST /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments => generated 194 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:39.740729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:39.756940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:39.795242 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:39.798472 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:39.798921 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:39.799769 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:39.831962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:39.834073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:39.976984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=12 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:40.411445 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:40.428818 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-22fec601-f1f6-4b84-b404-c1195d969a48 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 1.157837 Aug 30 00:58:40.431805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 186/378] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:39 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:41.313302 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:41.326391 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:41.327901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:41.336760 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0b1787f5-dd69-4f44-a6ad-b9a0dba7010f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 1.611165 Aug 30 00:58:41.337382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 193/379] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:39 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:41.453394 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:41.454011 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:41.462904 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:41.463473 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:41.463908 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:41.464657 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:41.465110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:41.465535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:41.694710 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:41.709318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bae854bc-a239-4941-ac0c-63a490f4a900 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.259594 Aug 30 00:58:41.714235 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 187/380] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:41 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:42.366652 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:42.370792 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:42.381054 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:42.382802 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:42.383714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:42.385507 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:42.386721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:42.388278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:42.733783 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:42.734418 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:42.743273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:42.744013 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:42.744655 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:42.745555 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:42.746191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:42.750106 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:42.782667 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:42.797450 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:42.800161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:42.801651 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3c2c4b87-da31-4d07-a8bd-10e1ee08f994 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.440786 Aug 30 00:58:42.803057 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 194/381] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:42 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:42.987284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:43.011050 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-833a69de-7eda-494d-85a1-b20cf146c4c0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.274778 Aug 30 00:58:43.028513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 188/382] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:42 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:43.826308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:43.827672 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:43.837520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=4 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:43.844194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:43.845052 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:43.847170 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:43.848775 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:43.849237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:43.849659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:44.035914 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:44.037249 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:44.039914 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=4 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:44.057113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:44.057833 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:44.058506 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:44.059677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:44.060348 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:44.061198 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:44.348115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:44.387488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:44.389400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:44.391071 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c06e735a-eb54-4903-badb-22e3df7efa69 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.568849 Aug 30 00:58:44.399342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 195/383] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:43 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:44.635909 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:44.646378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-eb9f986e-16bb-4dd3-a3fc-5508dc0046e2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.614445 Aug 30 00:58:44.647508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 189/384] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:44 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:58:45.435095 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:45.435754 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:45.466985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:45.470112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:45.471655 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:45.473866 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:45.476820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:45.478511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:45.693388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:45.694135 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:45.727572 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:45.733041 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:45.733899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:45.737438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:45.738187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:45.738879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:45.975411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:45.995632 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:46.007046 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:46.010570 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-88475b85-fbc5-4082-8f81-f3dfc722eebf tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.592586 Aug 30 00:58:46.016122 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 196/385] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:45 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:46.397737 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:46.416309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fda51a9a-3cb7-456c-9207-dc6b3fb01efa tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.752006 Aug 30 00:58:46.416914 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 190/386] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:45 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:47.041698 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:47.043055 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:47.050225 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:47.055851 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:47.056320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:47.057085 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:47.057545 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:47.057969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:47.303579 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:47.333310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:47.336717 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:47.340405 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-27d27246-223b-47ae-9a5c-cb9aad70ac3e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.303601 Aug 30 00:58:47.343891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 197/387] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:47 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:47.440909 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:47.442333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:47.482356 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:47.493645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:47.494678 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:47.498746 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:47.505837 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:47.508105 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:47.888098 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:47.899727 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9fb04720-a589-421e-9f59-d83b136d22b4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.464964 Aug 30 00:58:47.921934 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 191/388] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:47 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:48.366358 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:48.367624 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:48.373876 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:48.376836 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:48.377628 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:48.378293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:48.379421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:48.380315 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:48.380908 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:48.736820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:48.748090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:48.755851 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:48.757516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2e320c03-f9cd-4579-84a6-06718ccd21e3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1738 microversion: 2.20 time: 0.395520 Aug 30 00:58:48.761234 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 198/389] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:48 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:48.937196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:48.940274 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:48.959027 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:48.959780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:48.960397 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:48.961105 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:48.962348 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:48.962774 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:49.185642 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:49.186436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:49.194102 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:49.194845 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:49.195476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:49.196365 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:49.196969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:49.197542 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:49.222937 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:49.239397 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-685ba0d4-c970-42b0-bc54-4dfeb0171a31 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.306948 Aug 30 00:58:49.240755 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 192/390] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:48 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:49.472408 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:49.482973 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-50f5014e-e42d-4cfa-ae4d-ad52f041a2f7 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1595 microversion: 2.1 time: 0.301501 Aug 30 00:58:49.483591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 199/391] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:49 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1595 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:49.781905 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:49.782340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:49.792069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:49.792555 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:49.792985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:49.796648 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:49.797176 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:49.798631 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:50.014940 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:50.025300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:50.028005 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:50.030132 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4762f1a0-dbeb-48c6-8a79-a8a7319e69dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1720 microversion: 2.20 time: 0.253073 Aug 30 00:58:50.032424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 193/392] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:49 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1720 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:50.260499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:50.261594 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:50.269237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:50.269795 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:50.270339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:50.271151 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:50.271669 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:50.272178 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:50.494530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:50.505083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-aad68e7e-37b4-4b73-8d82-c066983988ec tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.248650 Aug 30 00:58:50.505790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 200/393] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:50 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:50.929276 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-fc21d7f8-2993-4b06-a55b-a4275ce52753 req-789645e3-d731-4943-8cf4-59bb9af312da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac33e3d7-0988-43ef-be96-21ad64b2825a", "name": "network-vif-plugged", "status": "completed", "tag": "b9464aee-4ec1-4b42-9b48-87dd1b038f79"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:50.951870 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-fc21d7f8-2993-4b06-a55b-a4275ce52753 req-789645e3-d731-4943-8cf4-59bb9af312da service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:50.952805 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-fc21d7f8-2993-4b06-a55b-a4275ce52753 req-789645e3-d731-4943-8cf4-59bb9af312da service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:50.953500 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-fc21d7f8-2993-4b06-a55b-a4275ce52753 req-789645e3-d731-4943-8cf4-59bb9af312da service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:50.966878 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-fc21d7f8-2993-4b06-a55b-a4275ce52753 req-789645e3-d731-4943-8cf4-59bb9af312da service nova] Creating event network-vif-plugged:b9464aee-4ec1-4b42-9b48-87dd1b038f79 for instance ac33e3d7-0988-43ef-be96-21ad64b2825a on hv-cinder-81574 Aug 30 00:58:50.972489 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-fc21d7f8-2993-4b06-a55b-a4275ce52753 req-789645e3-d731-4943-8cf4-59bb9af312da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047590 Aug 30 00:58:50.974214 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 201/394] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:51.065517 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:51.067816 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:51.068200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d3035653-cb22-4671-90a0-fbd83b96d0a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Action: 'create', calling method: .version_select at 0x7f03a1f7ac10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-694307074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJc0DBGwdeTmg1cdi2CAyvWhtYgI1DhVEK4ngaJo7zBX6ZXQbnDF2Lm7SKBF4njPOxeE9ntDIX0cq8d1a27rmjDAxNBBw+hvaUbJ1Ro+OElDPhrw1Sh9VQXYrxfWeC6JZQ=="}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:51.073948 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:51.080342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:51.081320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:51.082900 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:51.084032 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:51.084820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:51.085436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:51.085839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-d3035653-cb22-4671-90a0-fbd83b96d0a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Getting quotas for project d4baca9d3a3e45d883482957e9ce8cb0. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:58:51.090129 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-d3035653-cb22-4671-90a0-fbd83b96d0a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Getting quotas for user 455284c947254207a719459efc031bea and project d4baca9d3a3e45d883482957e9ce8cb0. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:58:51.127514 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d3035653-cb22-4671-90a0-fbd83b96d0a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.325336 Aug 30 00:58:51.128738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 194/395] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 00:58:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:51.355085 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:51.365012 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:51.366916 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:51.368463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-db17ec87-56c9-4a85-b501-ccea3d35b350 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1720 microversion: 2.20 time: 0.313815 Aug 30 00:58:51.369413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 202/396] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:51 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:51.528545 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:51.530118 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:51.553451 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:51.554293 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:51.554951 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:51.555929 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:51.556535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:51.557112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:51.870729 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:51.886701 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8903f6dd-0ed7-418e-9c4a-5ad3bf566d42 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.360577 Aug 30 00:58:51.887678 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 195/397] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:51 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:52.392633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:52.393971 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:52.400859 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:52.402414 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:52.403373 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:52.404482 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:52.405892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:52.407090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:52.590933 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:52.601633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:52.603844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:52.605318 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a049d12a-50bc-4510-928e-6bf005d7a41d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1720 microversion: 2.20 time: 0.217917 Aug 30 00:58:52.606741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 203/398] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:52 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:52.795522 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-e2cd1f32-4314-478f-8723-bee5264e443d req-9b9d2526-6e14-4031-a15d-597d315db978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c0d07e-f0f7-4abf-b406-39e4c0870f54", "tag": "94520acc-41df-40eb-bec9-b1c1e5e125c5"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:52.816186 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e2cd1f32-4314-478f-8723-bee5264e443d req-9b9d2526-6e14-4031-a15d-597d315db978 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:52.816671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e2cd1f32-4314-478f-8723-bee5264e443d req-9b9d2526-6e14-4031-a15d-597d315db978 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:52.820476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e2cd1f32-4314-478f-8723-bee5264e443d req-9b9d2526-6e14-4031-a15d-597d315db978 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:52.873090 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-e2cd1f32-4314-478f-8723-bee5264e443d req-9b9d2526-6e14-4031-a15d-597d315db978 service nova] Creating event network-changed:94520acc-41df-40eb-bec9-b1c1e5e125c5 for instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 on hv-cinder-81574 Aug 30 00:58:52.881107 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-e2cd1f32-4314-478f-8723-bee5264e443d req-9b9d2526-6e14-4031-a15d-597d315db978 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090780 Aug 30 00:58:52.882276 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 196/399] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:52.909237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:52.909900 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:52.917123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:52.917703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:52.918327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:52.919153 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:52.919618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:52.920094 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:53.013127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-7b5c0b63-05f9-4cd2-b6fb-79a3a11605d7 req-ffa05273-b162-4133-baea-acb800c14c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7bbc0c-7d22-46e1-82f5-784e10ce23f3", "name": "network-vif-unplugged", "status": "completed", "tag": "f8cd35a2-3f40-45d7-aeeb-e642ffc6e344"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:53.024749 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-7b5c0b63-05f9-4cd2-b6fb-79a3a11605d7 req-ffa05273-b162-4133-baea-acb800c14c70 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:53.025502 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-7b5c0b63-05f9-4cd2-b6fb-79a3a11605d7 req-ffa05273-b162-4133-baea-acb800c14c70 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:53.026191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-7b5c0b63-05f9-4cd2-b6fb-79a3a11605d7 req-ffa05273-b162-4133-baea-acb800c14c70 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:53.089545 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-7b5c0b63-05f9-4cd2-b6fb-79a3a11605d7 req-ffa05273-b162-4133-baea-acb800c14c70 service nova] Creating event network-vif-unplugged:f8cd35a2-3f40-45d7-aeeb-e642ffc6e344 for instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 on hv-cinder-81574 Aug 30 00:58:53.108140 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-7b5c0b63-05f9-4cd2-b6fb-79a3a11605d7 req-ffa05273-b162-4133-baea-acb800c14c70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099423 Aug 30 00:58:53.109848 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 197/400] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 00:58:53.509883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:53.519060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f8205be9-cbdf-4824-a409-1a4557b90a6f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.614704 Aug 30 00:58:53.538145 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 204/401] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:52 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:53.630309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:53.631778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:53.646731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:53.647538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:53.648526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:53.654191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:53.656517 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:53.656960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:53.904151 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:53.914507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:53.915981 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:53.917146 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-768c4df1-760d-4041-8744-3393ed0267f9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1723 microversion: 2.20 time: 0.291806 Aug 30 00:58:53.932224 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 198/402] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:53 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:53.945728 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07b05c8b-f472-4deb-8592-4278bc1924da"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:53.948762 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:53.968616 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:53.969107 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:53.969531 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:53.970240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:53.985375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:53.987570 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:54.130369 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:54.515122 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-762a6a9c-6d61-4420-bbd8-065016b546e4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.574669 Aug 30 00:58:54.516494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 205/403] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Aug 30 00:58:53 2022] POST /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments => generated 188 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 00:58:54.545646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:54.546688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:54.562717 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:54.563544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:54.564681 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:54.570129 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:54.570897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:54.571554 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:54.773315 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:54.774200 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:54.790204 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:54.793536 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:58:54.797870 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:54.798904 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:54.800645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fc562ecf-78a6-49c6-bb86-a4cd7310d15e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.257715 Aug 30 00:58:54.801263 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:54.801975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 199/404] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:54 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:54.806523 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:54.807306 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:54.807999 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:54.931808 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=144777) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 00:58:55.060899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-276997599"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:55.062741 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:55.074089 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:55.075707 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:55.078642 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:55.080833 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:55.081410 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4281fc30-c741-4f98-9156-49fdd6654a24 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/action" status: 202 len: 0 microversion: 2.20 time: 0.312313 Aug 30 00:58:55.082143 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:55.087796 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 206/405] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 30 00:58:54 2022] POST /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 00:58:55.088460 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:55.100119 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:55.101061 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:55.115876 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:55.119204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:55.124128 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:55.125358 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:55.126145 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:55.126722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:55.368257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.network.security_group_api [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Adding security group 724d498d-ebad-43f9-b45a-7a919df05e36 to port 94520acc-41df-40eb-bec9-b1c1e5e125c5 Aug 30 00:58:55.432245 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:55.445575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:55.448262 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:55.459667 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e0657436-2ef9-4bca-9c6c-89f02e460d14 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1749 microversion: 2.20 time: 0.369968 Aug 30 00:58:55.460448 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 207/406] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:55 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1749 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:55.830000 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:55.832175 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:55.838685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:55.839590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:55.840297 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:55.841279 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:55.841929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:55.842560 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:56.042490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-76617a1b-11fe-43f2-bff1-44f4ef805557 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "POST /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/action" status: 202 len: 0 microversion: 2.1 time: 0.989201 Aug 30 00:58:56.044082 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 200/407] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:58:55 2022] POST /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/action => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 00:58:56.054532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:56.055169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:56.087398 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:56.088846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:56.089521 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:56.090414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:56.091077 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:56.091775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:56.284642 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:56.293803 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-506e557c-591a-4034-9201-dc76059a557a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1370 microversion: 2.1 time: 0.471956 Aug 30 00:58:56.295713 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 208/408] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:55 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1370 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:56.308810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-eef4007f-b925-4cea-a0ee-8405dcb52d6e req-cc3bb885-8a09-4245-8d04-b7938d78d56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c0d07e-f0f7-4abf-b406-39e4c0870f54", "tag": "94520acc-41df-40eb-bec9-b1c1e5e125c5"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:56.323048 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-eef4007f-b925-4cea-a0ee-8405dcb52d6e req-cc3bb885-8a09-4245-8d04-b7938d78d56e service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:56.323534 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-eef4007f-b925-4cea-a0ee-8405dcb52d6e req-cc3bb885-8a09-4245-8d04-b7938d78d56e service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:56.323955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-eef4007f-b925-4cea-a0ee-8405dcb52d6e req-cc3bb885-8a09-4245-8d04-b7938d78d56e service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:56.338453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-eef4007f-b925-4cea-a0ee-8405dcb52d6e req-cc3bb885-8a09-4245-8d04-b7938d78d56e service nova] Creating event network-changed:94520acc-41df-40eb-bec9-b1c1e5e125c5 for instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 on hv-cinder-81574 Aug 30 00:58:56.344805 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-eef4007f-b925-4cea-a0ee-8405dcb52d6e req-cc3bb885-8a09-4245-8d04-b7938d78d56e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045584 Aug 30 00:58:56.345983 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 209/409] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:56.384883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:56.401265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d8d10dd3-7423-42c2-a7e2-18d590e357c1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1760 microversion: 2.1 time: 0.351938 Aug 30 00:58:56.404021 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 201/410] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:56 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1760 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:56.486048 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:56.486918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:56.496575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:56.497353 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:56.497989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:56.498940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:56.499981 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:56.500676 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:56.737476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:56.753237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:56.754827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:56.756045 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-834991e6-f003-4838-b5f1-390e1ac10274 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1749 microversion: 2.20 time: 0.275693 Aug 30 00:58:56.756947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 210/411] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:56 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1749 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:57.317218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:57.317909 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:57.325824 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:57.326302 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:57.326738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:57.327574 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:57.328019 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:57.328431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:57.475021 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:57.485387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-da5400d9-c3b7-4584-b3bf-4be8fd37db21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1564 microversion: 2.1 time: 0.172535 Aug 30 00:58:57.486500 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 202/412] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:57 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:58:57.506712 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:57.507302 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:57.514112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:57.514598 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:57.515115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:57.516030 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:57.516649 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:57.517231 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:57.617519 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-dcd2e611-2927-4259-9029-ab98943c8ee0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115099 Aug 30 00:58:57.618103 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 211/413] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 30 00:58:57 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:57.784988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:57.785848 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:57.792322 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:57.793057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:57.793653 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:57.794508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:57.795133 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:57.795710 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:57.928871 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-748522182", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1989786991", "security_groups": [{"name": "tempest-secgroup-smoke-1020886653"}], "networks": [{"uuid": "e2989fbf-44be-4168-b3d0-10928bbe8cc0"}], "block_device_mapping_v2": [{"uuid": "b486d067-3591-46d0-80ec-959c64178f39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:58.067561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:58.076467 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:58.078016 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:58.079220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7b0aef62-5b5b-4f2e-9140-74d038dca7d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.298456 Aug 30 00:58:58.079978 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 203/414] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:57 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:58:58.147997 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] validate_networks() for [('e2989fbf-44be-4168-b3d0-10928bbe8cc0', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:58:59.099999 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:58:59.100668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:58:59.101123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:58:59.101960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:58:59.102560 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:58:59.104361 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:59.105046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:59.115558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:59.115978 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:59.116464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:59.117111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:59.117846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:59.118706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:59.119329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:59.119897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:59.120719 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:59.121753 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:59.122217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:59.122635 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:59.143257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Getting quotas for project 2b0736ff08ae4fa6be73ec678c98077f. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:58:59.149647 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Getting quotas for user 1558d42f4c7f437495af05d4c8c42e6e and project 2b0736ff08ae4fa6be73ec678c98077f. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:58:59.229168 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:58:59.231906 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b486d067-3591-46d0-80ec-959c64178f39',volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:58:59.359662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:59.375433 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:59.377240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:59.378744 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-de62310b-cfb3-40b0-ad37-074d0c8d8cb1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.280140 Aug 30 00:58:59.391033 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 204/415] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:58:59 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:58:59.391033 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-c5b7fe58-3253-40e5-bbb9-90039527632e req-9b79e18e-9824-4a96-ba50-14c5d113e561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac33e3d7-0988-43ef-be96-21ad64b2825a", "tag": "b9464aee-4ec1-4b42-9b48-87dd1b038f79"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:58:59.394830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c5b7fe58-3253-40e5-bbb9-90039527632e req-9b79e18e-9824-4a96-ba50-14c5d113e561 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:58:59.395414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c5b7fe58-3253-40e5-bbb9-90039527632e req-9b79e18e-9824-4a96-ba50-14c5d113e561 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:58:59.395921 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c5b7fe58-3253-40e5-bbb9-90039527632e req-9b79e18e-9824-4a96-ba50-14c5d113e561 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:58:59.416260 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-c5b7fe58-3253-40e5-bbb9-90039527632e req-9b79e18e-9824-4a96-ba50-14c5d113e561 service nova] Creating event network-changed:b9464aee-4ec1-4b42-9b48-87dd1b038f79 for instance ac33e3d7-0988-43ef-be96-21ad64b2825a on hv-cinder-81574 Aug 30 00:58:59.423991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-c5b7fe58-3253-40e5-bbb9-90039527632e req-9b79e18e-9824-4a96-ba50-14c5d113e561 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042695 Aug 30 00:58:59.424907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 205/416] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:58:59.440772 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a5ef6a3c-093d-4296-b5d4-ab1c22612198 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.517882 Aug 30 00:58:59.441935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 212/417] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:58:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:58:59.455259 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-02dccfd6-9aad-4321-8831-2d0f0539e310 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:58:59.456026 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-02dccfd6-9aad-4321-8831-2d0f0539e310 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:58:59.566317 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-02dccfd6-9aad-4321-8831-2d0f0539e310 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:58:59.576621 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-02dccfd6-9aad-4321-8831-2d0f0539e310 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1088 microversion: 2.1 time: 0.127137 Aug 30 00:58:59.591215 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 206/418] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:58:59 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1088 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:00.404740 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:00.406416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:00.418459 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:00.419143 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:00.419720 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:00.420614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:00.421349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:00.421975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:00.596925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:00.599402 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:00.600086 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:00.606310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:00.607339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:00.607829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:00.608259 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:00.608894 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:00.609033 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:00.609475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:00.610017 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:00.611033 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-480cc137-4276-4800-aa8d-7534fb82f038 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.212917 Aug 30 00:59:00.623674 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 213/419] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:00 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:00.701181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:00.709687 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0cd428cf-75d1-4240-a839-3a45ba34bdd0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.115252 Aug 30 00:59:00.720018 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 207/420] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:00 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:01.640664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:01.641288 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:01.648188 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:01.648674 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:01.649105 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:01.649802 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:01.650249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:01.650667 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:01.732223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:01.733279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:01.746024 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:01.746516 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:01.747104 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:01.747910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:01.748361 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:01.748772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:01.804766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:01.815614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:01.817393 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:01.819114 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-dff66483-7f0c-476f-8553-93b68aef001e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.182612 Aug 30 00:59:01.820142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 214/421] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:01 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:01.828145 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:01.837870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-84b3d05b-8952-4466-ae1d-991f286c752d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.109446 Aug 30 00:59:01.843618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 208/422] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:01 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:02.842289 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:02.843026 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:02.850190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:02.851665 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:02.851665 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:02.851958 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:02.852395 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:02.852802 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:02.866061 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:02.867558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:02.878018 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:02.879276 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:02.879786 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:02.880574 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:02.881314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:02.881969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:02.972225 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:02.982522 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1f401e23-d08a-45a7-ab49-2c4978b6587d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.121051 Aug 30 00:59:02.983353 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 209/423] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:02 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:03.050503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:03.062378 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:03.064201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:03.065733 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-26a36ab2-00be-407f-99a4-09a82d166e4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.227683 Aug 30 00:59:03.066353 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 215/424] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:02 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:04.006314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:04.007728 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:04.020852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:04.021815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:04.022599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:04.023640 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:04.024119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:04.024583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:04.092755 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:04.095837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:04.097944 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:04.104372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:04.104852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:04.105305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:04.106002 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:04.106109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c6542ba6-e1ac-4672-aed4-b6feb40f78ad tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.103942 Aug 30 00:59:04.106806 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 210/425] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:04 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:04.106925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:04.107315 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:04.251764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:04.260557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:04.261960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:04.263156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b29958d0-63f7-4904-9b16-1b50afd114d5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.176075 Aug 30 00:59:04.263911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 216/426] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:04 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:59:05.128202 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:05.128896 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:05.135604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:05.136060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:05.136485 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:05.137172 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:05.137611 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:05.138008 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:05.208251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:05.216315 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-27529623-4449-43dd-885f-edb7573e3b65 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.092290 Aug 30 00:59:05.216890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 211/427] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:05 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:05.288286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:05.288925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:05.297833 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:05.298399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:05.298836 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:05.299596 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:05.300062 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:05.300483 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:05.449332 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:05.459585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:05.461166 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:05.462348 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-46db9fd2-9e71-4c85-9967-11356b663c7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.178495 Aug 30 00:59:05.462923 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 217/428] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:05 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:06.300592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:06.302502 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:06.309393 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:06.310215 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:06.310812 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:06.311953 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:06.312557 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:06.313153 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:06.382246 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:06.390884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5f0454ab-1047-4ca6-a0d5-bbeb62bcd45f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.094873 Aug 30 00:59:06.391574 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 212/429] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:06 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:06.486310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:06.487187 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:06.493881 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:06.494363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:06.494792 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:06.495521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:06.495967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:06.496383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:06.668127 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:06.680494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:06.688970 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:06.690645 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5f4dfd80-c86d-4a20-ba7a-0f394d538233 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.208559 Aug 30 00:59:06.691945 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 218/430] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:06 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:07.412303 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:07.413827 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:07.421063 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:07.421700 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:07.422180 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:07.422906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:07.425064 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:07.428355 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:07.494731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:07.504560 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fb3130e8-e873-4fc1-be81-d5dccdf83983 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.096251 Aug 30 00:59:07.505151 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 213/431] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:07 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:07.713863 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:07.714486 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:07.721158 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:07.721633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:07.722063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:07.722843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:07.723312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:07.723896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:07.870013 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:07.879717 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:07.881215 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:07.882386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ab016e67-dbab-42a7-b448-295491cf12a8 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.172478 Aug 30 00:59:07.882940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 219/432] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:07 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:08.526341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:08.527039 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:08.534351 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:08.535210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:08.535931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:08.536993 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:08.537901 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:08.538779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:08.611242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:08.620173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-97fc9fe2-d3d2-4323-804a-0f2dda72d7e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.097618 Aug 30 00:59:08.620950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 214/433] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:08 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:08.907325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:08.909318 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:08.917170 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:08.917995 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:08.918453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:08.919432 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:08.919879 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:08.920282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:09.080843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:09.085603 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:09.091434 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:09.092990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:09.094261 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d80fa41b-e34c-4bc7-8255-4a6478b8dc7d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.192302 Aug 30 00:59:09.094810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 220/434] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:08 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:09.643687 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:09.644251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:09.647264 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:09.652853 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:09.653321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:09.653750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:09.654415 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:09.654854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:09.655290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:09.720813 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:09.728938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9e0ab6d6-4eac-4a27-8090-26bd86b8f931 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1138 microversion: 2.1 time: 0.089277 Aug 30 00:59:09.729507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 215/435] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:09 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:10.117738 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:10.118328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:10.121551 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:10.122229 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:10.128465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:10.128953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:10.129380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:10.130070 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:10.130549 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:10.131088 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:10.274557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:10.289383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:10.291718 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:10.293477 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8e99a0fe-41ef-4c2f-8cc4-ee762c7cc78d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.179846 Aug 30 00:59:10.294244 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 221/436] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:10 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:10.754134 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:10.755078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:10.766682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:10.767190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:10.767617 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:10.768301 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:10.768741 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:10.769270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:10.839869 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:10.848493 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5878a152-97d3-4dd7-8661-67214ee4ca40 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1186 microversion: 2.1 time: 0.101174 Aug 30 00:59:10.849057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 216/437] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:10 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1186 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:11.322115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:11.322742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:11.329878 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:11.330349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:11.330761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:11.331537 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:11.331964 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:11.332388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:11.468175 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:11.477337 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:11.478733 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:11.479942 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-35fb8a69-94d3-46b5-a005-725a61826f34 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.163292 Aug 30 00:59:11.480463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 222/438] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:11 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:11.869720 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:11.870394 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:11.877217 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:11.877774 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:11.878270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:11.879043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:11.879584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:11.880055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:11.959204 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:11.968297 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ccd5458c-9e35-4000-afb8-7f24babd9a74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1204 microversion: 2.1 time: 0.102316 Aug 30 00:59:11.969360 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 217/439] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:11 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:12.502159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:12.503631 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:12.511939 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:12.512816 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:12.513638 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:12.514364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:12.514960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:12.515566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:12.662021 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:12.670938 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:12.672555 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:12.673821 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-27b78c07-43b6-4646-9071-fa44bdd61998 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.175871 Aug 30 00:59:12.674484 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 223/440] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:12 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:12.990339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:12.990992 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:12.999509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:13.000009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:13.000555 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:13.001982 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:13.003185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:13.003888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:13.026151 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:13.174796 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:13.184743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-92e3e4d9-24f9-441c-8554-37954171d4f0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.198684 Aug 30 00:59:13.185314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 218/441] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:12 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:13.196031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-4281af98-ee89-4b45-b50a-a4cb2bb4e7dc req-fd2557ee-cdf6-45ad-89ec-aacd68f6b599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f572fa1-3226-46e6-9899-4fcf86fd92f1", "tag": "073c1fdc-8ca9-494e-8140-91ded92f4916"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:13.205975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-4281af98-ee89-4b45-b50a-a4cb2bb4e7dc req-fd2557ee-cdf6-45ad-89ec-aacd68f6b599 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:13.206446 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-4281af98-ee89-4b45-b50a-a4cb2bb4e7dc req-fd2557ee-cdf6-45ad-89ec-aacd68f6b599 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:13.207092 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-4281af98-ee89-4b45-b50a-a4cb2bb4e7dc req-fd2557ee-cdf6-45ad-89ec-aacd68f6b599 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:13.218557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-4281af98-ee89-4b45-b50a-a4cb2bb4e7dc req-fd2557ee-cdf6-45ad-89ec-aacd68f6b599 service nova] Creating event network-changed:073c1fdc-8ca9-494e-8140-91ded92f4916 for instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 on hv-cinder-81574 Aug 30 00:59:13.224121 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-4281af98-ee89-4b45-b50a-a4cb2bb4e7dc req-fd2557ee-cdf6-45ad-89ec-aacd68f6b599 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031667 Aug 30 00:59:13.225134 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 224/442] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:13.246671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-732702135", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-694307074", "security_groups": [{"name": "tempest-secgroup-smoke-1699795873"}], "block_device_mapping_v2": [{"uuid": "f25803fe-38bf-4bbd-a68c-d44c865dbc30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3714421d-bb5b-438f-b69d-78d97ba32811"}]}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:13.375902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] validate_networks() for [('3714421d-bb5b-438f-b69d-78d97ba32811', None, None, None, None, None)] {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 00:59:13.698657 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:13.699540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:13.705972 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:13.706460 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:13.706884 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:13.707668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:13.708124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:13.708548 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:13.798211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 00:59:13.798634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 00:59:13.799130 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 00:59:13.799540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 00:59:13.799951 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 00:59:13.809722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:13.810328 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:13.811080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:13.811946 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:13.812410 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:13.812874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:13.835937 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Getting quotas for project d4baca9d3a3e45d883482957e9ce8cb0. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 00:59:13.840189 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Getting quotas for user 455284c947254207a719459efc031bea and project d4baca9d3a3e45d883482957e9ce8cb0. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 00:59:13.861321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:13.870095 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:13.871569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:13.872748 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c247ffb6-0b59-4254-81f2-6baa9e220288 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.178920 Aug 30 00:59:13.873310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 225/443] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:13 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:59:13.898703 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 00:59:13.900880 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f25803fe-38bf-4bbd-a68c-d44c865dbc30',volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 00:59:14.050695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-774c9b7b-59bb-47bb-a67c-4d1d33c4b776 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.807709 Aug 30 00:59:14.052920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 219/444] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 00:59:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 00:59:14.064772 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6620e025-f463-4c66-82c1-0fd18b07d7a2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:14.066515 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6620e025-f463-4c66-82c1-0fd18b07d7a2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:14.119691 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6620e025-f463-4c66-82c1-0fd18b07d7a2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:14.127676 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6620e025-f463-4c66-82c1-0fd18b07d7a2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1093 microversion: 2.1 time: 0.068058 Aug 30 00:59:14.128531 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 226/445] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:14 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:14.206773 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:14.207401 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:14.213694 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:14.214004 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:14.214450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:14.215348 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:14.215795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:14.216387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:14.369469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:14.380954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-edead7a0-ab83-4349-ab0e-9cfc6fa87fc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.178586 Aug 30 00:59:14.381558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 220/446] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:14 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:14.896464 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:14.897073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:14.903762 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:14.904239 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:14.904675 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:14.905368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:14.905819 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:14.906240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:15.046832 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:15.060962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:15.063648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:15.064844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0f0e9d35-610a-4e66-b86c-f475d577f4db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.172729 Aug 30 00:59:15.065413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 227/447] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:14 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:15.147644 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:15.148206 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:15.155159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:15.155643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:15.156079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:15.156867 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:15.157424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:15.157849 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:15.221540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:15.234604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bb7d1ef6-dae0-499b-9015-f7ebaadf2133 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1191 microversion: 2.1 time: 0.090705 Aug 30 00:59:15.235576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 221/448] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:15 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:15.401314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:15.401824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:15.409470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:15.410236 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:15.410686 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:15.411652 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:15.412087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:15.412797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:15.556340 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:15.564832 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-aec291c5-1f8e-4e00-9e47-c5c567c68385 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.167587 Aug 30 00:59:15.565682 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 228/449] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:15 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:16.088299 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:16.088911 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:16.096546 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:16.097043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:16.097477 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:16.098215 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:16.098618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:16.099046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:16.255081 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:16.257068 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:16.257681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:16.265662 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:16.266353 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:16.266769 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:16.267456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:16.267917 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:16.268744 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:16.269092 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f3c7b4ef-2c60-479c-9a6f-57c0ec27e82f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.184834 Aug 30 00:59:16.269619 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:16.270245 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:16.281910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 222/450] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:16 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:16.427683 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:16.435893 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-594a39f5-5e16-44f1-b17c-952aa00083b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1277 microversion: 2.1 time: 0.183465 Aug 30 00:59:16.443078 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 229/451] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:16 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:16.587482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:16.588069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:16.594827 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:16.594827 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:16.595308 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:16.596000 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:16.596441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:16.596860 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:16.747448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:16.756685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c24b1cc8-f306-4f50-aa9b-7bec1d7e00a4 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.173053 Aug 30 00:59:16.757259 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 223/452] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:16 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:16.851563 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-95eaa19f-0b68-43d4-8fcf-9444e78f362d req-36976a24-06e2-48cc-ad97-9e45777838ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7f85e9-692b-454e-95f3-5dc087400373", "tag": "67b64a6a-d7e2-4d07-8bc8-55d834fdb95c"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:16.862369 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-95eaa19f-0b68-43d4-8fcf-9444e78f362d req-36976a24-06e2-48cc-ad97-9e45777838ab service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:16.862893 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-95eaa19f-0b68-43d4-8fcf-9444e78f362d req-36976a24-06e2-48cc-ad97-9e45777838ab service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:16.863282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-95eaa19f-0b68-43d4-8fcf-9444e78f362d req-36976a24-06e2-48cc-ad97-9e45777838ab service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:16.874927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-95eaa19f-0b68-43d4-8fcf-9444e78f362d req-36976a24-06e2-48cc-ad97-9e45777838ab service nova] Creating event network-changed:67b64a6a-d7e2-4d07-8bc8-55d834fdb95c for instance 9b7f85e9-692b-454e-95f3-5dc087400373 on hv-cinder-81574 Aug 30 00:59:16.880300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-95eaa19f-0b68-43d4-8fcf-9444e78f362d req-36976a24-06e2-48cc-ad97-9e45777838ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032460 Aug 30 00:59:16.880864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 230/453] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:17.292676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:17.293382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:17.300510 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:17.301260 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:17.301688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:17.302413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:17.302853 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:17.303473 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:17.442716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:17.452193 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:17.453821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:17.455714 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7cb3a1d9-ba74-43ae-bde7-322eedb5a9c1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.166455 Aug 30 00:59:17.456436 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 224/454] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:17 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:17.458548 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:17.459273 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:17.465793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:17.466279 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:17.466707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:17.467446 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:17.467896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:17.468314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:17.622490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:17.630986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6f5783c8-37bd-4940-89b4-ec95d34d5d0c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.176918 Aug 30 00:59:17.631583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 231/455] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:17 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:17.779444 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:17.780111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:17.786404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:17.786878 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:17.787436 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:17.788176 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:17.788619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:17.789065 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:17.922813 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:17.931036 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8e708a24-5d43-44a0-b053-3c379f678f27 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.155518 Aug 30 00:59:17.931592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 225/456] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:17 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:18.478641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:18.479243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:18.481723 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:18.487815 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:18.488320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:18.488731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:18.489423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:18.489863 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:18.490277 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:18.646177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:18.653244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:18.653827 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:18.655515 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:18.656928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:18.658707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9c983d1c-35ff-46bc-83e4-e59d7fa7b01d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.184015 Aug 30 00:59:18.659294 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 232/457] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:18 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:18.660666 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:18.661145 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:18.661575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:18.662268 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:18.662712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:18.663141 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:18.815350 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:18.823716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f9fb35d9-8fd8-40cf-aeb8-53827af5ae31 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.174297 Aug 30 00:59:18.824309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 226/458] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:18 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:18.953704 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:18.954436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:18.962056 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:18.962469 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:18.962903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:18.963635 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:18.964088 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:18.964517 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:19.109495 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:19.118060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2d38484e-3508-40be-b1b7-8f8b764d01e0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.169119 Aug 30 00:59:19.118634 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 233/459] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:18 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:19.682194 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:19.682748 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:19.690138 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:19.690610 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:19.691110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:19.691826 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:19.692287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:19.692695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:19.845430 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:19.846625 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:19.847390 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:19.855350 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:19.856051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:19.856238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:19.856505 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:19.857339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:19.857513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:19.857786 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:19.858470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:19.858668 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e192a29f-ce53-4cc3-8a4c-54a931689736 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.180611 Aug 30 00:59:19.859250 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 227/460] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:19 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:20.011967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:20.020625 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5be0f373-4ed5-4c7b-b993-d375234ef0d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.179448 Aug 30 00:59:20.021176 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 234/461] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:19 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:20.137965 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:20.138563 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:20.149100 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:20.150496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:20.150931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:20.151669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:20.152148 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:20.152563 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:20.297359 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:20.305793 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dda665cb-a8c3-4514-b6f8-0a28a5eb887b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.171656 Aug 30 00:59:20.306341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 228/462] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:20 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:20.887296 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:20.888010 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:20.895669 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:20.896155 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:20.896574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:20.897276 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:20.897726 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:20.898146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:21.036876 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:21.041598 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:21.042240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:21.045935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:21.047372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:21.048596 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-715ef478-5dac-49ad-a7ef-97d89290a255 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.165346 Aug 30 00:59:21.049392 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 235/463] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:20 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:21.050153 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:21.050641 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:21.051084 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:21.051795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:21.052242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:21.052659 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:21.136546 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-874b6cb1-24ff-4b7a-98a1-20cecddfad75 req-3337a921-18ce-42fb-b3b6-33cc5e08aabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7bbc0c-7d22-46e1-82f5-784e10ce23f3", "name": "network-vif-plugged", "status": "completed", "tag": "f8cd35a2-3f40-45d7-aeeb-e642ffc6e344"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:21.148679 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-874b6cb1-24ff-4b7a-98a1-20cecddfad75 req-3337a921-18ce-42fb-b3b6-33cc5e08aabd service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:21.149237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-874b6cb1-24ff-4b7a-98a1-20cecddfad75 req-3337a921-18ce-42fb-b3b6-33cc5e08aabd service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:21.149694 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-874b6cb1-24ff-4b7a-98a1-20cecddfad75 req-3337a921-18ce-42fb-b3b6-33cc5e08aabd service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:21.162293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-874b6cb1-24ff-4b7a-98a1-20cecddfad75 req-3337a921-18ce-42fb-b3b6-33cc5e08aabd service nova] Creating event network-vif-plugged:f8cd35a2-3f40-45d7-aeeb-e642ffc6e344 for instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 on hv-cinder-81574 Aug 30 00:59:21.167493 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-874b6cb1-24ff-4b7a-98a1-20cecddfad75 req-3337a921-18ce-42fb-b3b6-33cc5e08aabd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034709 Aug 30 00:59:21.168331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 236/464] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:21.199732 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:21.208761 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-125fbeae-3fe8-43e4-ace0-ad044297e9f5 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.170908 Aug 30 00:59:21.209528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 229/465] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:21 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:21.332534 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:21.333168 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:21.340800 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:21.341293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:21.341717 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:21.342450 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:21.342887 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:21.343348 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:21.483671 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:21.492512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-604ade60-1132-4a49-aa6e-fceb05a1baaf tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.165057 Aug 30 00:59:21.493500 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 237/466] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:21 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:22.073975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:22.074684 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:22.076887 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:22.084738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:22.085254 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:22.085677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:22.086432 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:22.087088 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:22.087674 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:22.229858 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:22.230426 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:22.237646 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:22.238124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:22.238549 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:22.239329 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:22.239780 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:22.240234 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:22.248177 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:22.257017 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:22.258425 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:22.259626 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-03bf1697-e75a-4770-8b84-afc0daba7800 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.191167 Aug 30 00:59:22.260183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 230/467] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:22 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:22.381997 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:22.394690 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-186df77d-6da7-40c4-aa52-ffc60e1669ff tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.168427 Aug 30 00:59:22.396130 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 238/468] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:22 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:22.446497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:22.446988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:22.453577 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:22.454055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:22.454568 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:22.455413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:22.455864 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:22.456280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:22.512454 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:22.513048 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:22.519363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:22.519846 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:22.520272 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:22.520965 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:22.521422 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:22.521852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:22.581404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'services' on Instance uuid 7d7655de-fe79-4bbd-abb5-5908ef3acda9 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:59:22.656931 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:22.665513 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fbb2a96c-0c24-4e88-9584-fe14bd647f07 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.156893 Aug 30 00:59:22.666090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 239/469] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:22 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:22.704902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f6e21ff0-e937-4717-8c15-9a4cd0609f42 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/os-volume_attachments/1153633e-2512-4466-9df9-3c8a5aa9402f" status: 202 len: 0 microversion: 2.1 time: 0.262174 Aug 30 00:59:22.705491 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 231/470] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 00:59:22 2022] DELETE /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/os-volume_attachments/1153633e-2512-4466-9df9-3c8a5aa9402f => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:59:23.191520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-0c8736f0-3e73-43d5-bccc-b477d662a37a req-976e5806-b430-4aea-9726-b64deaf72448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f572fa1-3226-46e6-9899-4fcf86fd92f1", "name": "network-vif-plugged", "status": "completed", "tag": "073c1fdc-8ca9-494e-8140-91ded92f4916"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:23.202705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0c8736f0-3e73-43d5-bccc-b477d662a37a req-976e5806-b430-4aea-9726-b64deaf72448 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:23.203453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0c8736f0-3e73-43d5-bccc-b477d662a37a req-976e5806-b430-4aea-9726-b64deaf72448 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:23.204037 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0c8736f0-3e73-43d5-bccc-b477d662a37a req-976e5806-b430-4aea-9726-b64deaf72448 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:23.221417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-0c8736f0-3e73-43d5-bccc-b477d662a37a req-976e5806-b430-4aea-9726-b64deaf72448 service nova] Creating event network-vif-plugged:073c1fdc-8ca9-494e-8140-91ded92f4916 for instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 on hv-cinder-81574 Aug 30 00:59:23.226650 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-0c8736f0-3e73-43d5-bccc-b477d662a37a req-976e5806-b430-4aea-9726-b64deaf72448 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040919 Aug 30 00:59:23.227338 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 240/471] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:23.284074 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:23.284753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:23.291584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:23.292066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:23.292497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:23.293181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:23.293629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:23.294044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:23.422039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:23.422772 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:23.429897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:23.430378 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:23.430788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:23.431667 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:23.432286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:23.442756 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:23.448538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:23.455299 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.460758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:23.462178 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:23.463483 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-86b14475-38bd-46b8-875b-45cba7d09786 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1807 microversion: 2.20 time: 0.184557 Aug 30 00:59:23.464640 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 232/472] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:23 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 00:59:23.589466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:23.597843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e1e0aee6-bbde-403c-b704-6eb3d7ef3a26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.180572 Aug 30 00:59:23.598382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 241/473] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:23 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:23.686070 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:23.686760 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:23.694058 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:23.694542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:23.694976 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:23.696165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:23.696165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:23.696535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:23.826654 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.842354 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:23.848550 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:23.851190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9dcdb81c-7876-44e4-b0cb-dbcc5886d72f tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.168978 Aug 30 00:59:23.852079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 233/474] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:23 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:24.488594 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:24.489136 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:24.491209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:24.498363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:24.498850 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:24.499280 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:24.499957 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:24.500400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:24.500811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:24.620168 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:24.620771 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:24.628257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:24.628713 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:24.629142 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:24.629841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:24.630288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:24.630695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:24.633476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:24.642435 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:24.643994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:24.645154 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fc5de099-ac78-45c7-9b5c-ef7d58011e5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1794 microversion: 2.20 time: 0.161844 Aug 30 00:59:24.645728 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 242/475] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 00:59:24 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1794 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 00:59:24.779779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:24.788139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5fb7988d-ba04-464b-b6bc-eb94f9fc6ef2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.171868 Aug 30 00:59:24.788714 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 234/476] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:24 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:24.872200 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:24.872814 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:24.879305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:24.879796 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:24.880227 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:24.880911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:24.881388 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:24.881807 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:25.032950 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:25.041255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a255da96-a2eb-49a7-b13d-deef3867b905 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.172940 Aug 30 00:59:25.041831 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 243/477] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:24 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:25.815420 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:25.816110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:25.824658 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:25.825240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:25.825779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:25.827154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:25.827734 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:25.828319 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:25.832976 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:25.953421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-beccbfd5-967d-4d4e-8b8a-ac5e2a79bba3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:25.961159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beccbfd5-967d-4d4e-8b8a-ac5e2a79bba3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:25.961648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beccbfd5-967d-4d4e-8b8a-ac5e2a79bba3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:25.962083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beccbfd5-967d-4d4e-8b8a-ac5e2a79bba3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:25.974033 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:25.982078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ac53a112-5e9b-4161-989f-84c933d73990 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.171288 Aug 30 00:59:25.982650 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 235/478] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:25 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:25.985162 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-beccbfd5-967d-4d4e-8b8a-ac5e2a79bba3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Going to try to stop instance {{(pid=144777) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 00:59:26.031334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-beccbfd5-967d-4d4e-8b8a-ac5e2a79bba3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/action" status: 202 len: 0 microversion: 2.1 time: 0.082097 Aug 30 00:59:26.032214 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 244/479] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:59:25 2022] POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:59:26.041015 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:26.041615 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:26.047790 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:26.048386 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:26.048954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:26.049649 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:26.050092 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:26.050513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:26.063666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:26.064961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:26.071361 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:26.071841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:26.072269 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:26.072973 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:26.073421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:26.073839 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:26.250278 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:26.258708 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-62b6b29b-c38f-4e26-83d9-0d3e3e971af6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.221516 Aug 30 00:59:26.259323 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 236/480] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:26 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:26.263132 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:26.270929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-df3abb86-55cd-4032-ae87-2015d158c11b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.211878 Aug 30 00:59:26.271506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 245/481] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:26 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:27.004210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:27.004806 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:27.011691 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:27.012174 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:27.012609 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:27.013305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:27.013759 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:27.014169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:27.153327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:27.161249 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-315668c6-abea-49bd-81f3-61b7ba18cdb0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.162226 Aug 30 00:59:27.161826 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 237/482] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:26 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:27.283381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:27.284123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:27.293549 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:27.294276 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:27.294892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:27.295111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:27.295863 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:27.296082 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:27.296491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:27.297086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:27.303134 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:27.303621 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:27.304051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:27.304749 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:27.305199 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:27.305620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:27.496499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:27.499960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:27.505404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b6203e29-1772-4268-8b69-4c153f290afe tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.227821 Aug 30 00:59:27.506682 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 246/483] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:27 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:27.519342 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d4be4503-06ab-4ae8-8ebe-2bef1cf073de tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1260 microversion: 2.1 time: 0.229923 Aug 30 00:59:27.522152 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 238/484] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:27 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1260 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:28.182668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:28.183293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:28.190408 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:28.190857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:28.191328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:28.192030 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:28.192476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:28.192889 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:28.533488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:28.533488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:28.539230 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:28.539701 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:28.540157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:28.540846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:28.541287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:28.541694 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:28.599885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:28.607860 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-05f96051-1460-442a-b1d1-7156f5e6d233 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.429092 Aug 30 00:59:28.608432 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 247/485] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:28 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:28.614489 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:28.615102 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:28.621363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:28.621869 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:28.622323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:28.623036 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:28.623533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:28.623954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:28.715937 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:28.725362 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f4858451-31c4-4e67-84c2-02fcfabc53b9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.200692 Aug 30 00:59:28.725935 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 239/486] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:28 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:28.775760 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:28.784453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7c8b9926-0157-46dc-8d77-33d52acd0e4a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1444 microversion: 2.1 time: 0.174927 Aug 30 00:59:28.784927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 248/487] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:28 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:28.805043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:28.806081 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:28.812486 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:28.813297 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:28.813724 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:28.814433 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:28.815074 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:28.815523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:28.959600 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:28.967807 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bf04c812-0850-45d6-9a14-8e9a352b3329 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1444 microversion: 2.1 time: 0.167166 Aug 30 00:59:28.968417 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 240/488] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:28 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:29.046567 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-1e4fced0-1087-4cad-a302-9058bd212e30 req-93c0f1c8-49cb-4e70-be89-089385073957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7f85e9-692b-454e-95f3-5dc087400373", "name": "network-vif-plugged", "status": "completed", "tag": "67b64a6a-d7e2-4d07-8bc8-55d834fdb95c"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:29.057516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-1e4fced0-1087-4cad-a302-9058bd212e30 req-93c0f1c8-49cb-4e70-be89-089385073957 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:29.058462 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-1e4fced0-1087-4cad-a302-9058bd212e30 req-93c0f1c8-49cb-4e70-be89-089385073957 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:29.058462 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-1e4fced0-1087-4cad-a302-9058bd212e30 req-93c0f1c8-49cb-4e70-be89-089385073957 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:29.072454 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-1e4fced0-1087-4cad-a302-9058bd212e30 req-93c0f1c8-49cb-4e70-be89-089385073957 service nova] Creating event network-vif-plugged:67b64a6a-d7e2-4d07-8bc8-55d834fdb95c for instance 9b7f85e9-692b-454e-95f3-5dc087400373 on hv-cinder-81574 Aug 30 00:59:29.077374 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-1e4fced0-1087-4cad-a302-9058bd212e30 req-93c0f1c8-49cb-4e70-be89-089385073957 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035014 Aug 30 00:59:29.078226 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 249/489] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:29.630360 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:29.631207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:29.638144 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:29.638675 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:29.639181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:29.639882 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:29.640330 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:29.640751 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:29.747587 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:29.759779 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:29.768733 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:29.769220 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:29.769636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:29.770372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:29.770828 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:29.771288 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:29.940810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:29.948743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a945e8e5-e594-4972-bd6c-ed969d941779 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.323368 Aug 30 00:59:29.961998 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 241/490] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:29 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:30.017230 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:30.025824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-37cfc922-d868-4651-8790-f29427cd02a1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.283062 Aug 30 00:59:30.026392 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 250/491] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:29 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:30.918317 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-d6f3f7bb-c025-45e1-8757-e00eef4f0153 req-ab3b1e93-c2cf-495c-a273-2dca7b665719 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f572fa1-3226-46e6-9899-4fcf86fd92f1", "tag": "073c1fdc-8ca9-494e-8140-91ded92f4916"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:30.928147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d6f3f7bb-c025-45e1-8757-e00eef4f0153 req-ab3b1e93-c2cf-495c-a273-2dca7b665719 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:30.928823 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d6f3f7bb-c025-45e1-8757-e00eef4f0153 req-ab3b1e93-c2cf-495c-a273-2dca7b665719 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:30.929236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d6f3f7bb-c025-45e1-8757-e00eef4f0153 req-ab3b1e93-c2cf-495c-a273-2dca7b665719 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:30.941358 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-d6f3f7bb-c025-45e1-8757-e00eef4f0153 req-ab3b1e93-c2cf-495c-a273-2dca7b665719 service nova] Creating event network-changed:073c1fdc-8ca9-494e-8140-91ded92f4916 for instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 on hv-cinder-81574 Aug 30 00:59:30.946415 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-d6f3f7bb-c025-45e1-8757-e00eef4f0153 req-ab3b1e93-c2cf-495c-a273-2dca7b665719 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031794 Aug 30 00:59:30.946998 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 242/492] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:30.969687 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:30.970383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:30.977424 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:30.977906 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:30.978332 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:30.979060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:30.979492 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:30.979902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:31.048154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:31.049629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:31.056455 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:31.057024 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:31.057493 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:31.058356 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:31.059188 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:31.059608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:31.160623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:31.170128 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ea6fecc9-acaf-4acb-9702-20c48b9f9921 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1265 microversion: 2.1 time: 0.204313 Aug 30 00:59:31.171224 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 251/493] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:30 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:31.225879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:31.233885 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4337a19d-101b-4691-88cd-20552cea9949 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.190022 Aug 30 00:59:31.234504 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 243/494] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:31 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:32.192868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:32.193384 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:32.200563 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:32.201043 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:32.201466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:32.202154 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:32.202588 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:32.203028 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:32.256438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:32.257022 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:32.263386 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:32.263860 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:32.264287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:32.264985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:32.265428 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:32.265840 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:32.381743 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:32.390156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-18c5df71-faa7-48cd-9c3c-8b999fdb39e6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1453 microversion: 2.1 time: 0.202253 Aug 30 00:59:32.390735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 252/495] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:32 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1453 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:32.411728 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:32.412453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:32.419199 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:32.419688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:32.420118 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:32.420823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:32.421275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:32.421696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:32.426657 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:32.434585 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-efb05d9e-82ff-4e44-a892-063d194b986e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.182356 Aug 30 00:59:32.435189 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 244/496] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:32 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:32.566607 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:32.579334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-79e1438e-7120-47fa-a5c5-ecfa71dd3e19 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1453 microversion: 2.1 time: 0.171818 Aug 30 00:59:32.580423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 253/497] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:32 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:33.457437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:33.458241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:33.465229 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:33.465801 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:33.466295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:33.467230 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:33.467775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:33.468241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:33.678597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:33.688870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d0b7868b-42d3-4d5b-a69a-3b3ab7be11b1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.236096 Aug 30 00:59:33.689768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 245/498] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:33 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:34.690392 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-28c6d595-7f25-404c-81ae-6f8e004924cf req-91230271-842a-49e6-a5ba-af606e969bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7f85e9-692b-454e-95f3-5dc087400373", "tag": "67b64a6a-d7e2-4d07-8bc8-55d834fdb95c"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:34.700540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-28c6d595-7f25-404c-81ae-6f8e004924cf req-91230271-842a-49e6-a5ba-af606e969bb7 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:34.700997 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-28c6d595-7f25-404c-81ae-6f8e004924cf req-91230271-842a-49e6-a5ba-af606e969bb7 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:34.701418 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-28c6d595-7f25-404c-81ae-6f8e004924cf req-91230271-842a-49e6-a5ba-af606e969bb7 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:34.709948 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:34.710671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:34.713323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-28c6d595-7f25-404c-81ae-6f8e004924cf req-91230271-842a-49e6-a5ba-af606e969bb7 service nova] Creating event network-changed:67b64a6a-d7e2-4d07-8bc8-55d834fdb95c for instance 9b7f85e9-692b-454e-95f3-5dc087400373 on hv-cinder-81574 Aug 30 00:59:34.717972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:34.718671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:34.719217 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:34.719746 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-28c6d595-7f25-404c-81ae-6f8e004924cf req-91230271-842a-49e6-a5ba-af606e969bb7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033605 Aug 30 00:59:34.719909 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:34.720703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 254/499] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 00:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:34.720984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:34.721469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:34.864549 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:34.873647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fd6b9c0f-3bba-4c87-b070-ff5c9a0c84e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.167655 Aug 30 00:59:34.874959 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 246/500] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:34 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:35.896892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:35.897582 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:35.904663 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:35.905137 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:35.905566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:35.906249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:35.906700 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:35.907163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:35.967123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:35.969419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:35.976440 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:35.976910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:35.977343 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:35.978031 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:35.978468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:35.978875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:36.054572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:36.058204 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-69f2b3ea-3ab2-47ec-8ca0-83cafcd2dc9e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "POST /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/action" status: 202 len: 0 microversion: 2.1 time: 0.094888 Aug 30 00:59:36.058836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 247/501] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:59:35 2022] POST /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:59:36.063187 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5347bb7b-f5e3-4a0f-97b1-2bff9cfad4f8 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.171384 Aug 30 00:59:36.064055 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 255/502] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:35 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:36.073730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:36.074595 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:36.082872 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:36.083383 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:36.083812 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:36.084528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:36.084973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:36.085387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:36.235391 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:36.244304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-80cc5131-7d9b-41be-b1dc-bcdca5ef7ecc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1752 microversion: 2.1 time: 0.180412 Aug 30 00:59:36.245047 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 248/503] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:36 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 00:59:37.086271 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:37.086883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:37.093826 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:37.094302 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:37.094732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:37.095471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:37.095914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:37.096314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:37.242869 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:37.251546 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1a23cc90-b572-468d-b5fc-3f03e5cf13b6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.168992 Aug 30 00:59:37.251956 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 256/504] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:37 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:37.269149 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:37.269774 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:37.276869 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:37.277338 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:37.277758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:37.278442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:37.278884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:37.279330 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:37.430828 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:37.440121 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-edecb035-995d-4681-96af-06a6420a8133 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.176220 Aug 30 00:59:37.440859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 249/505] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:37 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:38.281687 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:38.283090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:38.290190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:38.290701 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:38.291173 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:38.291859 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:38.292310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:38.292737 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:38.440285 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:38.448385 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-de500b4b-fa1a-4e09-8fc9-5eaa48ccc29b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.173269 Aug 30 00:59:38.448954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 257/506] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:38 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:38.461191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:38.461851 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:38.468582 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:38.469059 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:38.469539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:38.470233 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:38.470679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:38.471127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:38.616285 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:38.625146 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1ff1fe9f-975b-4057-8442-8ac8627e29b9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.167870 Aug 30 00:59:38.625713 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 250/507] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:38 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:39.469974 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:39.470652 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:39.478012 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:39.478493 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:39.478917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:39.479670 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:39.480112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:39.480534 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:39.484823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:39.629570 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:39.637899 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d7dddd05-7aeb-43b1-8d5a-beb47dc99928 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.171996 Aug 30 00:59:39.638482 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 258/508] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:39 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:39.653013 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:39.653651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:39.661071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:39.661557 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:39.661983 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:39.662682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:39.663155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:39.663572 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:39.682260 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:39.822776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:39.835564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e4ab07cd-66b8-47b1-9cbf-47f47f70163f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.186098 Aug 30 00:59:39.836442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 251/509] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:39 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:40.662984 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:40.663638 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:40.670623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:40.671039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:40.671494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:40.672185 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:40.672634 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:40.673055 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:40.810221 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:40.828340 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b2e29da6-eed4-4493-9dd4-54f33a757ec2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1675 microversion: 2.1 time: 0.169633 Aug 30 00:59:40.828932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 259/510] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:40 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:40.862495 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:40.863232 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:40.870239 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:40.870818 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:40.871314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:40.872095 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:40.872635 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:40.873179 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:41.028128 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:41.039130 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-49e8727e-80c8-42b5-b2a2-d803cbf975b1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.181183 Aug 30 00:59:41.039703 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 252/511] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:40 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:41.855054 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:41.856031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:41.865112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:41.865779 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:41.866369 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:41.867347 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:41.867954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:41.870915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:42.022515 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:42.032428 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a6d09706-266f-49e0-b644-918683bc3364 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1652 microversion: 2.1 time: 0.182333 Aug 30 00:59:42.033278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 260/512] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:41 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1652 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:42.054072 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dfa6e42d-eb7a-4c4a-9281-4c2d91071702 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:42.060115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:42.060721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:42.061104 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfa6e42d-eb7a-4c4a-9281-4c2d91071702 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:42.061578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfa6e42d-eb7a-4c4a-9281-4c2d91071702 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:42.062006 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfa6e42d-eb7a-4c4a-9281-4c2d91071702 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:42.067381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:42.067861 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:42.068272 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:42.068986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:42.069437 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:42.069858 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:42.123044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dfa6e42d-eb7a-4c4a-9281-4c2d91071702 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Going to try to start instance {{(pid=144776) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 00:59:42.172059 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dfa6e42d-eb7a-4c4a-9281-4c2d91071702 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/action" status: 202 len: 0 microversion: 2.1 time: 0.121817 Aug 30 00:59:42.172692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 253/513] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:59:42 2022] POST /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 00:59:42.181338 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:42.182017 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:42.190543 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:42.191482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:42.191954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:42.192890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:42.193413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:42.193840 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:42.225947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:42.235342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-39045ce1-fe45-4dbf-9d25-0ba9b166903e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.178912 Aug 30 00:59:42.236128 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 261/514] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:42 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:42.327287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:42.335205 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0dccf0f8-fbc8-4ad0-b6f7-dcfc560cb345 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1661 microversion: 2.1 time: 0.157964 Aug 30 00:59:42.335776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 254/515] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:42 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:43.258934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:43.259580 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:43.270106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:43.270590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:43.271035 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:43.271742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:43.272205 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:43.272622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:43.358538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:43.359166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:43.366196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:43.366673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:43.368411 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:43.369115 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:43.369559 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:43.369974 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:43.453183 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:43.461950 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-163b2771-19fa-4a56-afac-425cb7ddd8a0 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.208434 Aug 30 00:59:43.462489 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 262/516] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:43 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:43.520304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:43.528755 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e335c034-5f2c-40f1-9bdf-ba8cae558f1d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1661 microversion: 2.1 time: 0.175904 Aug 30 00:59:43.529325 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 255/517] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:43 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1661 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:44.490078 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:44.490697 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:44.497665 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:44.498144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:44.498570 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:44.499283 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:44.499731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:44.500174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:44.552828 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:44.553447 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:44.560306 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:44.560782 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:44.562129 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:44.563218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:44.563684 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:44.564105 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:44.717511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:44.727278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-43bcd2cb-6ed2-4101-bece-683ed560cd2f tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.241887 Aug 30 00:59:44.727868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 263/518] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:44 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:44.740751 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:44.748928 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4fe2eee3-370f-472d-a1a0-096a7de46bff tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1665 microversion: 2.1 time: 0.201612 Aug 30 00:59:44.749487 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 256/519] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:44 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1665 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:45.749471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:45.750072 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:45.756604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:45.757077 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:45.757526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:45.758232 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:45.758680 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:45.759147 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:45.907469 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:45.916617 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-898af014-5a8e-482e-8b70-318d35604407 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.171151 Aug 30 00:59:45.917191 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 264/520] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:45 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:46.628482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80503df4-9914-49ce-88da-a7e049ce277b"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:46.630924 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:46.638280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:46.638762 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:46.639241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:46.639939 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:46.640388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:46.640808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:46.927544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-24ed7eb4-1262-4d08-9ac4-413759700efc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304139 Aug 30 00:59:46.928224 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 257/521] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 00:59:46 2022] POST /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 00:59:46.938039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:46.938658 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:46.945744 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:46.946237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:46.946671 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:46.947400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:46.947880 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:46.948271 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:47.102011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:47.110775 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c8605441-e1ae-4f7c-b73f-d694607d2897 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.177082 Aug 30 00:59:47.111380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 265/522] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:46 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:48.135202 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:48.135914 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:48.142763 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:48.143536 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:48.144511 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:48.145564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:48.146216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:48.146816 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:48.293995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:48.303100 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1f74bc1a-2f29-40ba-b910-a77c3b2274dc tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.172837 Aug 30 00:59:48.303657 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 258/523] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:48 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:49.329147 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:49.330014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:49.333707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=68 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:49.342476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:49.343305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:49.344021 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:49.345150 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:49.345903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:49.346632 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:49.502990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:49.511616 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f2372c2b-d439-4916-9e14-a7b284985478 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.189165 Aug 30 00:59:49.512185 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 266/524] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:49 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:50.534795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:50.535596 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:50.544682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:50.545341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:50.545926 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:50.546866 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:50.547511 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:50.548080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:50.715603 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:50.727752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-02e4488b-1924-41ef-8d91-6caafb24ec14 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.198050 Aug 30 00:59:50.728573 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 259/525] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:50 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:51.754492 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:51.755123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:51.761802 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:51.762301 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:51.762728 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:51.763464 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:51.763909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:51.764323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:51.926142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:51.935124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e4656e9a-8767-4f30-8ace-a54c1e16eba1 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.185026 Aug 30 00:59:51.935674 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 267/526] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:51 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:52.959623 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:52.960236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:52.962752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=60 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:52.968252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:52.968728 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:52.969152 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:52.969837 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:52.970281 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:52.970695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:53.132603 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:53.146003 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-012a43ee-1993-496e-8ff3-2f82a0987266 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.191659 Aug 30 00:59:53.146862 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 260/527] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:52 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:54.172533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:54.173105 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:54.180520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:54.180982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:54.181410 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:54.182100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:54.182546 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:54.182967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:54.333140 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:54.342008 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b385451c-fb22-4096-bb68-4e5851692d0c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.173559 Aug 30 00:59:54.342579 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 268/528] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:54 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:54.514589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 00:59:54.516898 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:54.523582 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:54.524066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:54.524492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:54.525180 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:54.525627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:54.526046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:54.550284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lazy-loading 'flavor' on Instance uuid ac33e3d7-0988-43ef-be96-21ad64b2825a {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 00:59:54.697176 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9e63266b-047f-4b63-b777-e583ff250083 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/action" status: 200 len: 32 microversion: 2.1 time: 0.186475 Aug 30 00:59:54.697697 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 261/529] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 00:59:54 2022] POST /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 00:59:54.707415 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:54.708478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:54.714970 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:54.715491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:54.715982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:54.716728 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:54.717197 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:54.717635 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:54.855514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:54.866075 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b2b3e18c-e659-46cb-af66-a80645769e8b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.162501 Aug 30 00:59:54.866672 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 269/530] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:54 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:55.366193 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:55.366863 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:55.373631 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:55.374118 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:55.374553 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:55.375294 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:55.375742 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:55.376159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:55.527179 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:55.536061 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5eee7ba8-32d9-43ae-9cf0-934b900db50e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.175411 Aug 30 00:59:55.536764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 262/531] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:55 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:55.891885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:55.892495 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:55.899672 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:55.900152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:55.900564 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:55.901255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:55.901708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:55.902123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:56.036322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:56.045125 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d3a78b0c-3547-42cf-be16-297ac745f80b tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.157177 Aug 30 00:59:56.045687 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 270/532] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:55 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:56.562452 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:56.563494 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:56.574416 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:56.575254 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:56.575972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:56.577098 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:56.577843 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:56.578542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:56.740367 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:56.744021 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:59:56.749600 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b2d091f0-1c6c-496e-bad2-93927f41f4c6 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.193989 Aug 30 00:59:56.750190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 263/533] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:56 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:57.070652 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:57.071410 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:57.077855 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:57.078335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:57.078764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:57.079490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:57.079946 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:57.080364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:57.230246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:57.241757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-eb1e7af1-36a7-4d08-bad2-99a9167b38b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.177860 Aug 30 00:59:57.242323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 271/534] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:57 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:57.774073 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:57.774760 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:57.783561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:57.784165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:57.784692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:57.785549 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:57.786111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:57.786635 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:57.939866 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:57.948503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6f31908c-fd30-41fa-ae97-6bcedfaf08be tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1757 microversion: 2.1 time: 0.180462 Aug 30 00:59:57.949180 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 264/535] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:57 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:58.267410 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:58.268368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:58.279815 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:58.280621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:58.281338 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:58.282666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:58.283467 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:58.284167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:58.435556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:58.445737 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-741261b5-41b8-488b-9677-4251793995ed tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.184861 Aug 30 00:59:58.446321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 272/536] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:58 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:58.975201 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:58.975818 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:58.982805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:58.983318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:58.983752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:58.984441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:58.984891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:58.985310 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:59.131068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:59.140526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dfb3c7b3-d8b6-497a-beab-4c34a3b1cc09 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1760 microversion: 2.1 time: 0.169294 Aug 30 00:59:59.141094 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 265/537] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:58 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 00:59:59.472411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 00:59:59.473009 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 00:59:59.480167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:59.480648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:59.481074 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:59.481755 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 00:59:59.482205 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 00:59:59.482622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 00:59:59.628646 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 00:59:59.638940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-962d4557-0805-4da2-88c9-caa47f67ddc1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.170465 Aug 30 00:59:59.639544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 273/538] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 00:59:59 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:00.663046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:00.664094 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:00.671337 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:00.671813 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:00.672235 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:00.672922 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:00.673362 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:00.673774 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:00.812918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:00.821578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-766bafbc-aa70-4fda-9649-b7ac120936ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.164557 Aug 30 01:00:00.822165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 266/539] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:00 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:01.845885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:01.846502 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:01.856505 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:01.857128 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:01.857703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:01.858680 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:01.859146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:01.859707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:02.003700 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:02.007640 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:02.014097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-31b5541b-1829-41e7-99ab-56baa24bfd86 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.174486 Aug 30 01:00:02.014686 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 274/540] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:01 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:03.037024 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:03.037643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:03.044574 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:03.045058 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:03.045489 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:03.046166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:03.046614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:03.047044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:03.193429 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:03.206440 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f4044338-ab8e-411f-96e0-3acaf61caa75 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.173537 Aug 30 01:00:03.207122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 267/541] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:03 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:04.233534 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:04.234260 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:04.244068 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:04.244760 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:04.245302 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:04.246595 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:04.247334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:04.247986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:04.400373 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:04.409441 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5d8ef509-c29c-4516-a4fa-a639ed1034e4 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.181682 Aug 30 01:00:04.410022 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 275/542] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:04 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:05.431915 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:05.432676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:05.442749 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:05.443272 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:05.443701 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:05.444373 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:05.444855 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:05.445269 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:05.583068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:05.596255 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1ea98c4e-0e04-4c60-9113-efc182ffd6b0 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.168009 Aug 30 01:00:05.597106 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 268/543] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:05 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:06.622528 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:06.623843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:06.635239 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:06.635842 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:06.636250 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:06.637004 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:06.637452 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:06.637867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:06.783796 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:06.794101 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7c1043e5-d30e-4867-8ca1-24ff09589fdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.178457 Aug 30 01:00:06.794689 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 276/544] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:06 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:07.817171 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:07.817737 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:07.826064 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:07.826549 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:07.826984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:07.827718 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:07.828178 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:07.828599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:07.977552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:07.986393 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-687fff18-877d-4222-956f-cceae6236a2a tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.173810 Aug 30 01:00:07.986967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 269/545] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:07 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:09.009107 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:09.009752 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:09.016766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:09.017270 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:09.017688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:09.018549 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:09.019022 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:09.019445 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:09.165360 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:09.174299 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d63b3589-e663-48bc-9063-1e5779632a1d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.169157 Aug 30 01:00:09.174870 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 277/546] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:09 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:10.198712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:10.199388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:10.206344 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:10.206824 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:10.207398 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:10.208117 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:10.208569 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:10.208987 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:10.346492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:10.356075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-765a9956-0230-4009-a3d2-e24286881bc2 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.162544 Aug 30 01:00:10.356973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 270/547] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:10 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:11.390584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:11.391600 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:11.402088 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:11.402604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:11.403045 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:11.403757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:11.404208 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:11.404626 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:11.559179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:11.572312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c80206d1-1d50-4c92-873f-ff1f5b8befac tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.188383 Aug 30 01:00:11.573004 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 278/548] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:11 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:12.597192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:12.598155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:12.611079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:12.611079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:12.611079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:12.611079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:12.611552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:12.611552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:12.748582 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:12.757052 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c310f15e-35c2-4913-b439-8c204b99511c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.166500 Aug 30 01:00:12.757658 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 271/549] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:12 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:13.781667 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:13.782307 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:13.790339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:13.790902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:13.791447 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:13.792248 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:13.792768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:13.793381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:13.931818 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:13.944722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-05b50fd3-abaa-4e75-93e7-5c5c283e97ba tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.168415 Aug 30 01:00:13.945418 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 279/550] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:13 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:14.968169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:14.968746 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:14.975571 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:14.976040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:14.976465 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:14.977141 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:14.977598 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:14.978011 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:15.127794 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:15.140632 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-884f8512-d176-47cc-a87d-e04f23c76244 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.176390 Aug 30 01:00:15.141297 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 272/551] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:14 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:15.485857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:15.486468 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:15.492782 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:15.493263 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:15.493720 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:15.494417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:15.494868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:15.495315 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:15.532928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9e6c83a4-b5e6-417c-a770-020490bac2df tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments/07b05c8b-f472-4deb-8592-4278bc1924da" status: 200 len: 194 microversion: 2.20 time: 0.053501 Aug 30 01:00:15.533789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 280/552] 10.222.0.17 () {60 vars in 1454 bytes} [Tue Aug 30 01:00:15 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments/07b05c8b-f472-4deb-8592-4278bc1924da => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:15.605381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:15.606507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:15.613604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:15.614083 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:15.614512 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:15.615235 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:15.615688 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:15.616108 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:15.705752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lazy-loading 'services' on Instance uuid fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:00:15.786906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-aeb4b1c5-50c4-48a5-a68c-49e2bf7e56a9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments/07b05c8b-f472-4deb-8592-4278bc1924da" status: 202 len: 0 microversion: 2.20 time: 0.185499 Aug 30 01:00:15.787649 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 273/553] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Aug 30 01:00:15 2022] DELETE /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments/07b05c8b-f472-4deb-8592-4278bc1924da => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:15.800210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:15.803773 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:15.811479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:15.812308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:15.812733 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:15.813422 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:15.813877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:15.814289 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:15.844810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7d4f72c0-31a4-4214-b9fa-d3a8d99e402f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050704 Aug 30 01:00:15.845356 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 281/554] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 30 01:00:15 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:16.170702 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:16.171358 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:16.178223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:16.178685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:16.179148 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:16.179829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:16.180269 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:16.180681 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:16.322974 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:16.331887 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-21b2e5e2-f963-4b95-9842-cc2b12a8398f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.167984 Aug 30 01:00:16.332452 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 274/555] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:16 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:16.861996 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:16.865563 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:16.876955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:16.877767 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:16.878473 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:16.879644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:16.880380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:16.881156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:16.913100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5839e495-bd74-4062-9088-308176b361f5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058150 Aug 30 01:00:16.913644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 282/556] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 30 01:00:16 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:17.353838 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:17.354474 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:17.361859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:17.362388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:17.362829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:17.363600 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:17.364068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:17.364507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:17.510750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:17.520489 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5c8be0d2-3dd9-420d-a94a-883b2e17b0f8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.170844 Aug 30 01:00:17.521061 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 275/557] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:17 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:17.930506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:17.933904 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:17.941880 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:17.942357 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:17.942782 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:17.943594 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:17.944041 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:17.944461 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:17.974756 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1bdb0eed-326a-4294-8b76-ab8ee7687544 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051276 Aug 30 01:00:17.975362 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 283/558] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 30 01:00:17 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:18.545539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:18.546146 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:18.553161 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:18.553640 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:18.554078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:18.554758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:18.555250 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:18.555669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:18.698335 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:18.710689 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d84173ab-7cca-4cf0-a242-d38e8c8e5f0c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1735 microversion: 2.1 time: 0.171202 Aug 30 01:00:18.711586 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 276/559] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:18 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:18.988031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:18.990162 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:18.997263 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:18.997738 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:18.998583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:18.999210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:18.999662 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:19.000078 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:19.030500 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-cce956ff-f519-4507-991e-d0151ec85cfc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046669 Aug 30 01:00:19.031051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 284/560] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 30 01:00:18 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:19.118893 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:19.119722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:19.129286 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:19.129991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:19.130602 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:19.131695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:19.132292 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:19.132753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:19.159749 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:00:19.252018 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-37133745-3757-44d8-910c-96e85369a33b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 204 len: 0 microversion: 2.20 time: 0.138761 Aug 30 01:00:19.252698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 277/561] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 30 01:00:19 2022] DELETE /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:00:19.261262 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:19.261890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:19.268028 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:19.268496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:19.268919 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:19.269591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:19.270029 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:19.270471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:19.403504 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:19.412766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:19.414199 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:19.415795 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-669e3adc-d7ad-4e8c-ac91-25d5d427be4a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.158091 Aug 30 01:00:19.415896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 285/562] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:19 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:19.735814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:19.736471 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:19.743296 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:19.743775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:19.744199 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:19.744917 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:19.745360 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:19.745775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:19.750102 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:19.879381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:19.888042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d21f7ba9-9ab2-49f6-8596-edaccc3554bf tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1715 microversion: 2.1 time: 0.156930 Aug 30 01:00:19.888620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 278/563] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:19 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:20.009390 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:20.009935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:20.012219 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=40 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:20.018052 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:20.018528 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:20.018961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:20.019672 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:20.020119 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:20.020544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:20.163467 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] HTTP exception thrown: Cannot 'detach_volume' instance ac33e3d7-0988-43ef-be96-21ad64b2825a while it is in vm_state rescued Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Request method failure captured: Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: DELETE /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments/80503df4-9914-49ce-88da-a7e049ce277b HTTP/1.1 Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAZpwyg9_G7AFFXS_OTfo4jGYZHLvDJxY10FKJse4IyrqcRBKpZqfMUSTKUkO9jHIkzmwXlscxzwH_YQ7QqOLBbSVkYFjeKnXhqemnA7NlggBOZVflK3tbm569mlkgNPSL1T9so-ZOeqSMTQsTpNomQYJLwFCr4K_oT1abJ4reU11o Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:00:20.165083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a1cf0a235aa4669a9276c293a78f2eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}] Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 1d1c13089bd14d48ba637468182eee14 Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:00:20.166661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Cannot 'detach_volume' instance ac33e3d7-0988-43ef-be96-21ad64b2825a while it is in vm_state rescued Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'server_id': 'ac33e3d7-0988-43ef-be96-21ad64b2825a', 'id': '80503df4-9914-49ce-88da-a7e049ce277b'} Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac33e3d7-0988-43ef-be96-21ad64b2825a in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:00:20.167442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ac33e3d7-0988-43ef-be96-21ad64b2825a while it is in vm_state rescued Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ac33e3d7-0988-43ef-be96-21ad64b2825a while it is in vm_state rescued Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:00:20.168714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Returning 409 to user: Cannot 'detach_volume' instance ac33e3d7-0988-43ef-be96-21ad64b2825a while it is in vm_state rescued {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:00:20.169696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-af62c6ca-6d21-4277-9b54-0aa085380b21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments/80503df4-9914-49ce-88da-a7e049ce277b" status: 409 len: 152 microversion: 2.1 time: 0.161149 Aug 30 01:00:20.169696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 286/564] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:00:20 2022] DELETE /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments/80503df4-9914-49ce-88da-a7e049ce277b => generated 152 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 01:00:20.175890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:20.176414 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:20.183178 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:20.183857 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:20.184472 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:20.185475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:20.186218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:20.187218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:20.264848 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0b8e75c7-4b29-4e1f-b7cd-eb5f192450eb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "POST /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/action" status: 202 len: 0 microversion: 2.1 time: 0.092479 Aug 30 01:00:20.265207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 279/565] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 01:00:20 2022] POST /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:00:20.273478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:20.274087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:20.280431 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:20.281037 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:20.281496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:20.282152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:20.282580 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:20.283253 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:20.422230 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:20.432702 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5670dbd0-02c7-48b7-b5fa-f0ef4426277d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1723 microversion: 2.1 time: 0.163007 Aug 30 01:00:20.434637 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 287/566] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:20 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:20.438891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:20.439605 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:20.445992 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:20.446470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:20.446923 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:20.447620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:20.448060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:20.448475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:20.599889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:20.611619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:20.613065 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:20.614229 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-189f729b-33f1-4864-a3fc-ffb2afb975e2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.180095 Aug 30 01:00:20.614790 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 280/567] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:20 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:00:21.456665 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:21.457240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:21.464216 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:21.464695 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:21.465111 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:21.465774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:21.466236 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:21.466648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:21.607433 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:21.620053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1f14017f-ce6b-4d36-b585-144b2fb2d3bd tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1723 microversion: 2.1 time: 0.167147 Aug 30 01:00:21.620820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 288/568] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:21 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:21.637236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:21.637792 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:21.647171 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:21.647687 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:21.648121 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:21.648846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:21.649260 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:21.649865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:21.864009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:21.874156 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:21.875754 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:21.877032 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a3f67f7b-b4b6-426b-9679-6a8c33b79795 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1722 microversion: 2.20 time: 0.243726 Aug 30 01:00:21.877865 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 281/569] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:21 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:22.642238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:22.642840 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:22.649511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:22.649969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:22.650621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:22.651566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:22.652680 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:22.653299 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:22.675255 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-a762f8ea-4c05-4091-8560-cf7b9b955214 req-6c10c529-4ef8-49ce-b729-48776c18c109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7bbc0c-7d22-46e1-82f5-784e10ce23f3", "name": "network-vif-deleted", "tag": "f8cd35a2-3f40-45d7-aeeb-e642ffc6e344"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:22.685960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a762f8ea-4c05-4091-8560-cf7b9b955214 req-6c10c529-4ef8-49ce-b729-48776c18c109 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:22.686906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a762f8ea-4c05-4091-8560-cf7b9b955214 req-6c10c529-4ef8-49ce-b729-48776c18c109 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:22.691615 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a762f8ea-4c05-4091-8560-cf7b9b955214 req-6c10c529-4ef8-49ce-b729-48776c18c109 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:22.703766 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-a762f8ea-4c05-4091-8560-cf7b9b955214 req-6c10c529-4ef8-49ce-b729-48776c18c109 service nova] Creating event network-vif-deleted:f8cd35a2-3f40-45d7-aeeb-e642ffc6e344 for instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 on hv-cinder-81574 Aug 30 01:00:22.708795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-a762f8ea-4c05-4091-8560-cf7b9b955214 req-6c10c529-4ef8-49ce-b729-48776c18c109 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037426 Aug 30 01:00:22.709398 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 282/570] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:22.794597 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:22.803273 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-642e5b67-758c-4f34-a7aa-ca078bf0d462 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1723 microversion: 2.1 time: 0.165029 Aug 30 01:00:22.803848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 289/571] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:22 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:22.900623 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:22.901306 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:22.908046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:22.908522 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:22.909185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:22.909627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:22.910070 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:22.910492 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:22.976799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:22.985618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:22.986967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:22.988278 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f940d6a1-f343-4dcd-8078-fffa5be4ebea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1655 microversion: 2.20 time: 0.091997 Aug 30 01:00:22.989050 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 283/572] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:22 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:23.825381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:23.825945 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:23.833792 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:23.834392 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:23.834824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:23.835573 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:23.836014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:23.836554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:24.010519 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:24.011250 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:24.013420 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:24.013608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:24.021639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:24.022120 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:24.022550 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:24.023334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-10874eb4-1a09-48f4-8871-a672a1ba897c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1723 microversion: 2.1 time: 0.202209 Aug 30 01:00:24.035341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:24.035341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:24.035341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:24.035817 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 290/573] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:23 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:24.059975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:24.060451 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:24.060882 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:24.061752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lazy-loading 'fault' on Instance uuid fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:00:24.106139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:24.115037 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:24.116421 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:24.117576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-da4fce28-da37-4bf4-9bba-69a51480d631 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1371 microversion: 2.20 time: 0.111119 Aug 30 01:00:24.118136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 284/574] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:24 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:25.046077 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:25.046669 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:25.053379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:25.053848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:25.054276 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:25.054960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:25.055435 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:25.055847 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:25.081039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:25.141391 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:25.142151 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:25.149127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:25.149594 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:25.150055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:25.150739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:25.151234 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:25.151647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:25.184798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:25.185275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:25.185701 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:25.186215 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lazy-loading 'fault' on Instance uuid fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:00:25.213919 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:25.222911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-74e0bd05-8b31-47f9-b5fc-1c77227d511f tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1729 microversion: 2.1 time: 0.180736 Aug 30 01:00:25.223889 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 291/575] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:25 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:25.240509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:25.244900 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:25.245680 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:25.252435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:25.252867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:25.253352 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:25.253774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:25.253985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:25.254687 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:25.255230 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:25.255495 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dc30d27f-078f-4cc7-8562-83edd8d837ed tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 200 len: 1371 microversion: 2.20 time: 0.118749 Aug 30 01:00:25.255721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:25.256372 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 285/576] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:25 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:25.351425 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-eee30650-5657-4071-81b7-0277c5482f70 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110671 Aug 30 01:00:25.352220 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 292/577] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 30 01:00:25 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:00:26.278168 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:26.278784 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:26.286066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:26.286546 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:26.286974 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:26.287696 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:26.288148 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:26.288561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:26.304420 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] HTTP exception thrown: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Request method failure captured: Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 HTTP/1.1 Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWATEEZnk8p2SFyb9-vA8U2AmKZLs6y6M1r_XteV2aCo_ScnBGOW9QqavDLxzB2OuWN8zKG3vtIC2an9WjdcOcVRZ0gLeYeeOlG5j4a_aa49Bfs-sJ3ePxw9tdBewkS7fArCoJfSTGhyUeVxV0nwobD8WRYT4zHfRxKJyNde_GNrl0Y Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:00:26.306071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e36d98f444ec4d12a1a55ef450de63a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}] Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: f2a8b56e48b445709054849f4893767a Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:00:26.307722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'fe7bbc0c-7d22-46e1-82f5-784e10ce23f3'} Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:00:26.308476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:00:26.309889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:26.311639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Returning 404 to user: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:00:26.311639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1b256f83-e3c7-405b-b32e-9574807f9955 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 404 len: 111 microversion: 2.20 time: 0.033383 Aug 30 01:00:26.311639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 286/578] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:26 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:00:26.317646 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c76d36dc-308e-4b90-9c37-3d21f0f9ced1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '.version_select at 0x7f03a1f508b0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:26.338847 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c76d36dc-308e-4b90-9c37-3d21f0f9ced1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422795611" status: 204 len: 0 microversion: 2.20 time: 0.025509 Aug 30 01:00:26.339482 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 293/579] 10.222.0.17 () {60 vars in 1259 bytes} [Tue Aug 30 01:00:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422795611 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 01:00:26.612883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-7165d62b-b3ae-439a-bb86-2301e7ddb855 req-7033fbe0-cd76-436e-bcf9-9aa289739609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac33e3d7-0988-43ef-be96-21ad64b2825a", "tag": "b9464aee-4ec1-4b42-9b48-87dd1b038f79"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:26.625694 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-7165d62b-b3ae-439a-bb86-2301e7ddb855 req-7033fbe0-cd76-436e-bcf9-9aa289739609 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:26.626650 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-7165d62b-b3ae-439a-bb86-2301e7ddb855 req-7033fbe0-cd76-436e-bcf9-9aa289739609 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:26.627243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-7165d62b-b3ae-439a-bb86-2301e7ddb855 req-7033fbe0-cd76-436e-bcf9-9aa289739609 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:26.644576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-7165d62b-b3ae-439a-bb86-2301e7ddb855 req-7033fbe0-cd76-436e-bcf9-9aa289739609 service nova] Creating event network-changed:b9464aee-4ec1-4b42-9b48-87dd1b038f79 for instance ac33e3d7-0988-43ef-be96-21ad64b2825a on hv-cinder-81574 Aug 30 01:00:26.653535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-7165d62b-b3ae-439a-bb86-2301e7ddb855 req-7033fbe0-cd76-436e-bcf9-9aa289739609 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044801 Aug 30 01:00:26.654315 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 287/580] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:27.452002 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7778273d-367c-4ddc-8c46-5cefb7eef3c3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'create', calling method: .version_select at 0x7f03a1e69b80>, body: {"keypair": {"name": "tempest-keypair-1554300659", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb9vrILATyDaDnilEwExngxTtpgLOCQDF0rxFWJuFG/MIKVA664D39XGwMdOdotbWKM9KqErNau7Ja6r9tC8xWCmLnBDhCzZwIh2qPG6YQusTGWrV2d9tVNW4Y5C/Owtg=="}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:27.470673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-7778273d-367c-4ddc-8c46-5cefb7eef3c3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Getting quotas for project e36d98f444ec4d12a1a55ef450de63a5. Resources: {'key_pairs'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:00:27.475389 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-7778273d-367c-4ddc-8c46-5cefb7eef3c3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Getting quotas for user f2a8b56e48b445709054849f4893767a and project e36d98f444ec4d12a1a55ef450de63a5. Resources: {'key_pairs'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:00:27.504649 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7778273d-367c-4ddc-8c46-5cefb7eef3c3 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057359 Aug 30 01:00:27.505370 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 294/581] 10.222.0.17 () {62 vars in 1200 bytes} [Tue Aug 30 01:00:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 01:00:28.691544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-642aa80f-6482-4069-b524-6b5cf5d089e7 req-c57ce1cf-1cb4-4b80-bfdd-c2cf5c791055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac33e3d7-0988-43ef-be96-21ad64b2825a", "tag": "b9464aee-4ec1-4b42-9b48-87dd1b038f79"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:28.701662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-642aa80f-6482-4069-b524-6b5cf5d089e7 req-c57ce1cf-1cb4-4b80-bfdd-c2cf5c791055 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:28.702125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-642aa80f-6482-4069-b524-6b5cf5d089e7 req-c57ce1cf-1cb4-4b80-bfdd-c2cf5c791055 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:28.702647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-642aa80f-6482-4069-b524-6b5cf5d089e7 req-c57ce1cf-1cb4-4b80-bfdd-c2cf5c791055 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:28.713879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-642aa80f-6482-4069-b524-6b5cf5d089e7 req-c57ce1cf-1cb4-4b80-bfdd-c2cf5c791055 service nova] Creating event network-changed:b9464aee-4ec1-4b42-9b48-87dd1b038f79 for instance ac33e3d7-0988-43ef-be96-21ad64b2825a on hv-cinder-81574 Aug 30 01:00:28.718968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-642aa80f-6482-4069-b524-6b5cf5d089e7 req-c57ce1cf-1cb4-4b80-bfdd-c2cf5c791055 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033262 Aug 30 01:00:28.719606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 288/582] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:29.321766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1480897525", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54dd3c3b-76a1-4705-8049-764d2291f7aa"}], "security_groups": [{"name": "tempest-securitygroup--472703712"}], "key_name": "tempest-keypair-1554300659", "user_data": "}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:29.741661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] validate_networks() for [('54dd3c3b-76a1-4705-8049-764d2291f7aa', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:00:30.138261 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:00:30.138888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:00:30.140675 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:00:30.140793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:00:30.141353 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:00:30.158231 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:30.158713 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:30.159198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:30.159929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:30.160379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:30.160785 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:30.181847 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Getting quotas for project e36d98f444ec4d12a1a55ef450de63a5. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:00:30.188216 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Getting quotas for user f2a8b56e48b445709054849f4893767a and project e36d98f444ec4d12a1a55ef450de63a5. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:00:30.200264 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:00:30.202615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:00:30.254630 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7c5bc195-e9f7-433d-aebf-2b17c0ebc39d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.937679 Aug 30 01:00:30.255212 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 295/583] 10.222.0.17 () {62 vars in 1188 bytes} [Tue Aug 30 01:00:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 01:00:30.267902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-740f804d-c047-494b-858d-c931482b9ef4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:30.268574 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-740f804d-c047-494b-858d-c931482b9ef4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:30.329526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-740f804d-c047-494b-858d-c931482b9ef4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:30.338870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-740f804d-c047-494b-858d-c931482b9ef4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:30.340716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-740f804d-c047-494b-858d-c931482b9ef4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:30.342531 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-740f804d-c047-494b-858d-c931482b9ef4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1282 microversion: 2.20 time: 0.079397 Aug 30 01:00:30.343297 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 289/584] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:30 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:31.369848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:31.370862 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:31.378392 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:31.378905 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:31.379365 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:31.380051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:31.380494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:31.380914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:31.450504 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:31.459206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:31.460673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:31.461790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a352ba08-5298-47f2-ac72-0f252f3fc8b2 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1334 microversion: 2.20 time: 0.099464 Aug 30 01:00:31.462357 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 296/585] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:31 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:32.485393 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:32.485983 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:32.492589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:32.493342 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:32.493938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:32.494811 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:32.495434 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:32.496022 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:32.757152 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:32.765641 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:32.767106 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:32.768220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c7af142d-c0dd-40db-b924-ddbd9d176882 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1407 microversion: 2.20 time: 0.287868 Aug 30 01:00:32.768996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 290/586] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:32 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:33.101767 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-f3f52f20-3c79-4e70-97e1-e37d2fba800f req-ea51a0a6-236f-4547-8891-cd622d0663fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "292814e8-5ed9-4973-beb5-106bb39d79d8", "tag": "38122c0f-dd5b-474a-bd39-f20d490b5a6f"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:33.112593 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-f3f52f20-3c79-4e70-97e1-e37d2fba800f req-ea51a0a6-236f-4547-8891-cd622d0663fd service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:33.113052 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-f3f52f20-3c79-4e70-97e1-e37d2fba800f req-ea51a0a6-236f-4547-8891-cd622d0663fd service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:33.113468 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-f3f52f20-3c79-4e70-97e1-e37d2fba800f req-ea51a0a6-236f-4547-8891-cd622d0663fd service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:33.125457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-f3f52f20-3c79-4e70-97e1-e37d2fba800f req-ea51a0a6-236f-4547-8891-cd622d0663fd service nova] Creating event network-changed:38122c0f-dd5b-474a-bd39-f20d490b5a6f for instance 292814e8-5ed9-4973-beb5-106bb39d79d8 on hv-cinder-81574 Aug 30 01:00:33.130739 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-f3f52f20-3c79-4e70-97e1-e37d2fba800f req-ea51a0a6-236f-4547-8891-cd622d0663fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033018 Aug 30 01:00:33.131355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 297/587] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:33.795073 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:33.796507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:33.806821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:33.807643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:33.808277 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:33.809444 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:33.810008 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:33.810698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:33.947990 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:33.956251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:33.957678 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:33.958783 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d13cfa37-8550-4e8f-b938-ef0b3889b191 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1407 microversion: 2.20 time: 0.170125 Aug 30 01:00:33.959374 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 291/588] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:33 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:34.982608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:34.983465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:34.989791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:34.990266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:34.990694 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:34.991403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:34.991846 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:34.992259 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:35.171054 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:35.179705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:35.181359 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:35.182422 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b353aceb-92a8-4fc6-9464-5d8bbb63b2ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1407 microversion: 2.20 time: 0.204774 Aug 30 01:00:35.183070 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 298/589] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:34 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:35.677389 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:35.679678 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:35.686542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:35.687076 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:35.687509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:35.688195 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:35.688640 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:35.689048 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:35.720896 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a75d1b58-5cbe-4280-855e-9c1b45974c4f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047551 Aug 30 01:00:35.721465 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 292/590] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:00:35 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:00:35.791599 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:35.792114 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:35.798463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:35.798940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:35.799402 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:35.800090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:35.800536 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:35.800955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:35.826413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:00:35.911101 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6a752363-10b4-4ee4-88f4-68950d7cbca7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 204 len: 0 microversion: 2.1 time: 0.123117 Aug 30 01:00:35.911671 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 299/591] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:00:35 2022] DELETE /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:35.919921 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:35.920526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:35.926625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:35.927113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:35.927538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:35.928214 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:35.928652 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:35.929093 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:36.120821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:36.129354 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-73bd4d03-262f-418b-9553-19a45dd9d082 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1671 microversion: 2.1 time: 0.213300 Aug 30 01:00:36.129918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 293/592] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:35 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1671 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:36.206755 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:36.207482 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:36.216728 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:36.217511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:36.217887 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:36.218583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:36.219049 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:36.219481 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:36.410240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:36.418969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:36.420488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:36.421837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-93a4424d-bba9-4e68-b0bb-8b2ba93cc8e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1407 microversion: 2.20 time: 0.219545 Aug 30 01:00:36.422399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 300/593] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:36 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:00:37.150073 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:37.150780 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:37.158015 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:37.158500 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:37.158936 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:37.159665 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:37.160107 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:37.160526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:37.237247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-edfc550d-9c67-4518-ac64-4cc650290f07 req-b5ea331f-ff2d-4f99-8c65-94bb0aacc058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292814e8-5ed9-4973-beb5-106bb39d79d8", "name": "network-vif-plugged", "status": "completed", "tag": "38122c0f-dd5b-474a-bd39-f20d490b5a6f"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:37.254577 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-edfc550d-9c67-4518-ac64-4cc650290f07 req-b5ea331f-ff2d-4f99-8c65-94bb0aacc058 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:37.255364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-edfc550d-9c67-4518-ac64-4cc650290f07 req-b5ea331f-ff2d-4f99-8c65-94bb0aacc058 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:37.255790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-edfc550d-9c67-4518-ac64-4cc650290f07 req-b5ea331f-ff2d-4f99-8c65-94bb0aacc058 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:37.267532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-edfc550d-9c67-4518-ac64-4cc650290f07 req-b5ea331f-ff2d-4f99-8c65-94bb0aacc058 service nova] Creating event network-vif-plugged:38122c0f-dd5b-474a-bd39-f20d490b5a6f for instance 292814e8-5ed9-4973-beb5-106bb39d79d8 on hv-cinder-81574 Aug 30 01:00:37.272417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-edfc550d-9c67-4518-ac64-4cc650290f07 req-b5ea331f-ff2d-4f99-8c65-94bb0aacc058 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039724 Aug 30 01:00:37.273224 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 301/594] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:00:37.297077 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:37.304829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-89452438-71c6-4dd4-ae2f-27b25abfd569 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1671 microversion: 2.1 time: 0.158668 Aug 30 01:00:37.305395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 294/595] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:37 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:37.448528 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:37.449454 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:37.459571 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:37.460233 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:37.460814 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:37.461818 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:37.462459 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:37.462940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:37.614614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:37.625383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:37.626804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:37.627927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-93775931-7492-420a-8e95-62b1dcc6f950 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1407 microversion: 2.20 time: 0.186277 Aug 30 01:00:37.628497 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 302/596] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:37 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:38.331789 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:38.332812 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:38.343483 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:38.343937 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:38.344364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:38.345045 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:38.345488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:38.345896 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:38.486421 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:38.494348 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f51c2711-6368-43d8-8d71-fe8e33ed4517 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1671 microversion: 2.1 time: 0.169545 Aug 30 01:00:38.494964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 295/597] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:38 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:38.650338 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:38.650959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:38.658231 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:38.658722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:38.659189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:38.659888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:38.660316 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:38.660732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:38.797438 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:38.805762 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:38.807220 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:38.808330 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e0d961c9-e7c4-46cf-a45c-df812ad7a64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1407 microversion: 2.20 time: 0.162151 Aug 30 01:00:38.808867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 303/598] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:38 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:39.239741 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-a76bb4c2-4f91-4359-8853-7ee9b02b96d7 req-954d7cf6-7f73-4d10-9e59-f67ba7e7da03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7655de-fe79-4bbd-abb5-5908ef3acda9", "name": "network-vif-deleted", "tag": "39a645ef-ee25-4b8b-8d72-db1a360a6891"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:39.252139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a76bb4c2-4f91-4359-8853-7ee9b02b96d7 req-954d7cf6-7f73-4d10-9e59-f67ba7e7da03 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:39.252612 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a76bb4c2-4f91-4359-8853-7ee9b02b96d7 req-954d7cf6-7f73-4d10-9e59-f67ba7e7da03 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:39.253037 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a76bb4c2-4f91-4359-8853-7ee9b02b96d7 req-954d7cf6-7f73-4d10-9e59-f67ba7e7da03 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:39.264695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-a76bb4c2-4f91-4359-8853-7ee9b02b96d7 req-954d7cf6-7f73-4d10-9e59-f67ba7e7da03 service nova] Creating event network-vif-deleted:39a645ef-ee25-4b8b-8d72-db1a360a6891 for instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 on hv-cinder-81574 Aug 30 01:00:39.269696 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-a76bb4c2-4f91-4359-8853-7ee9b02b96d7 req-954d7cf6-7f73-4d10-9e59-f67ba7e7da03 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033858 Aug 30 01:00:39.270476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 296/599] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:39.517097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:39.517791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:39.524008 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:39.524548 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:39.525170 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:39.525860 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:39.526345 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:39.526742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:39.590481 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:39.599284 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3faf71aa-c1a6-44ea-b4bb-49f083368f36 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1322 microversion: 2.1 time: 0.086620 Aug 30 01:00:39.599954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 304/600] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:39 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:00:39.832315 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:39.832984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:39.839547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:39.840305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:39.840904 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:39.841900 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:39.842337 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:39.842772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:39.865299 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:40.034195 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:40.042790 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:40.044280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:40.046095 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fa9e7d27-6a57-40bd-8063-545beaa70d2d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1407 microversion: 2.20 time: 0.219088 Aug 30 01:00:40.046669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 297/601] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:39 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:40.620917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:40.622035 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:40.625040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:40.625889 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=10 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:40.631543 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:40.632026 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:40.632451 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:40.633142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:40.633593 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:40.634023 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:40.666965 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:40.667469 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:40.667904 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:40.668323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid 7d7655de-fe79-4bbd-abb5-5908ef3acda9 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:00:40.714304 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:40.721613 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1262ec72-4496-4ac0-a6ef-4c3168fcf2d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 200 len: 1327 microversion: 2.1 time: 0.104557 Aug 30 01:00:40.722201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 305/602] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:40 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:41.068999 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:41.069597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:41.071379 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:41.077730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:41.078199 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:41.078622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:41.079337 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:41.079782 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:41.080193 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:41.226011 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:41.238001 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:41.240637 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:41.244181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9f027ee9-8cd0-43fb-b7db-7194ae2d6ffc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1599 microversion: 2.20 time: 0.179065 Aug 30 01:00:41.245062 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 298/603] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:00:41 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1599 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:00:41.267914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:41.268387 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:41.275036 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:41.275525 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:41.275950 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:41.276627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:41.277067 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:41.277478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:41.369684 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-53920ef7-7186-49a1-8ccc-8d5565fea61e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105566 Aug 30 01:00:41.370621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 306/604] 10.222.0.17 () {60 vars in 1316 bytes} [Tue Aug 30 01:00:41 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:00:41.742913 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:41.743544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:41.756440 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-276997599"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:41.757025 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:41.762261 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:41.762757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:41.763223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:41.763330 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:41.763806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:41.764158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:41.764281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:41.764615 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:41.765041 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:41.765148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:41.765576 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:41.765989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:41.779883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] HTTP exception thrown: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Request method failure captured: Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 HTTP/1.1 Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAcUi_xogd_SxYF57wsmObM4wNkbRO_I6acBFO5oLmcUSX_h7wdj7XtkUFkTUCs24k6HORWaqzoN5NmcH6f_h1vkHyAu0ULxqOcKAki1KmG3e8PtN6NuXhFL-B5v_Huj18UKH4Gi0DMrxl2eNdya_Ef3FVm9Rwobz2rlMY7PodXxro Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:00:41.782238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e919c196d074b8989b4719267ce24f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}] Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 22f11e29c4ad4712a54877b0895d28a4 Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:00:41.783663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '7d7655de-fe79-4bbd-abb5-5908ef3acda9'} Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:00:41.784481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:00:41.785821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:41.786992 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Returning 404 to user: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:00:41.786992 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-41738c83-6de9-4f2c-8e36-d8ed9e5245d4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 404 len: 111 microversion: 2.1 time: 0.045261 Aug 30 01:00:41.788782 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 299/605] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:41 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:00:41.793619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7758db72-34a4-4db0-9219-ea956ee04d76 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '.version_select at 0x7f03a1daca60>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:41.816717 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7758db72-34a4-4db0-9219-ea956ee04d76 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-561868308" status: 202 len: 0 microversion: 2.1 time: 0.026741 Aug 30 01:00:41.817295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 300/606] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 30 01:00:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-561868308 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:00:42.008244 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.network.security_group_api [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Removing security group 724d498d-ebad-43f9-b45a-7a919df05e36 from port 94520acc-41df-40eb-bec9-b1c1e5e125c5 Aug 30 01:00:42.469500 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8e4bc620-7e85-44a0-a19a-b8947060d9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'create', calling method: .version_select at 0x7f03a1dc0f70>, body: {"keypair": {"name": "tempest-keypair-1966803583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGCjfcE2LvoYTZeusjA80uvanzA+ZO/RbxPFQEHU47tO2MPMkMfsrpCAAB211zKPzjSBdHq+0q6CrTrutUwlKMarTQrOvJUBNW8BIK/8jwDWMozVj7CZXWGvEUnfQQwRw=="}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:42.486712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-8e4bc620-7e85-44a0-a19a-b8947060d9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Getting quotas for project 7e919c196d074b8989b4719267ce24f8. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:00:42.490892 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-8e4bc620-7e85-44a0-a19a-b8947060d9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Getting quotas for user 22f11e29c4ad4712a54877b0895d28a4 and project 7e919c196d074b8989b4719267ce24f8. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:00:42.515030 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8e4bc620-7e85-44a0-a19a-b8947060d9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050190 Aug 30 01:00:42.515668 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 301/607] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 01:00:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:00:42.890678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b83f1d37-6df4-49d3-94c6-1a0c38dd5575 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "POST /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/action" status: 202 len: 0 microversion: 2.1 time: 1.138476 Aug 30 01:00:42.891764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 307/608] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 01:00:41 2022] POST /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/action => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:00:42.905173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-ccc18408-236f-4c61-bffd-4f7b31355a4e req-30e36f12-16cc-4627-9693-bd5df420cb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4c0d07e-f0f7-4abf-b406-39e4c0870f54", "tag": "94520acc-41df-40eb-bec9-b1c1e5e125c5"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:42.926280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ccc18408-236f-4c61-bffd-4f7b31355a4e req-30e36f12-16cc-4627-9693-bd5df420cb89 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:42.929355 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ccc18408-236f-4c61-bffd-4f7b31355a4e req-30e36f12-16cc-4627-9693-bd5df420cb89 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:42.930508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ccc18408-236f-4c61-bffd-4f7b31355a4e req-30e36f12-16cc-4627-9693-bd5df420cb89 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:42.957452 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-ccc18408-236f-4c61-bffd-4f7b31355a4e req-30e36f12-16cc-4627-9693-bd5df420cb89 service nova] Creating event network-changed:94520acc-41df-40eb-bec9-b1c1e5e125c5 for instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 on hv-cinder-81574 Aug 30 01:00:43.016911 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-ccc18408-236f-4c61-bffd-4f7b31355a4e req-30e36f12-16cc-4627-9693-bd5df420cb89 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114846 Aug 30 01:00:43.017568 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 302/609] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:44.699469 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1453555831", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46512a58-d3d5-4f03-89cc-6d31fd678fea"}], "security_groups": [{"name": "tempest-securitygroup--1270009319"}], "key_name": "tempest-keypair-1966803583", "user_data": "}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:44.737197 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:44.738023 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:44.745194 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:44.745742 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:44.746181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:44.746875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:44.747352 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:44.747858 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:44.820710 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] validate_networks() for [('46512a58-d3d5-4f03-89cc-6d31fd678fea', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:00:44.836418 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lazy-loading 'services' on Instance uuid d4c0d07e-f0f7-4abf-b406-39e4c0870f54 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:00:44.920145 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d5a5d8fa-1a0d-4102-a2d7-80a28e4a6132 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments/21d88adb-a569-4f97-a848-c4281351d2a0" status: 202 len: 0 microversion: 2.1 time: 0.188122 Aug 30 01:00:44.921585 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 303/610] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:00:44 2022] DELETE /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments/21d88adb-a569-4f97-a848-c4281351d2a0 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:00:44.932525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:44.935616 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:44.946454 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:44.946986 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:44.947649 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:44.948467 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:44.948915 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:44.949805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:44.988823 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-65647c48-c3e9-4171-aa5d-f05afe3e3d3c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061307 Aug 30 01:00:44.990640 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 304/611] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:00:44 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:45.034252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-f93ac195-de83-47b6-a624-831fb6b723bc req-06097578-9018-44ae-bd55-84cfa73cd89b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "292814e8-5ed9-4973-beb5-106bb39d79d8", "tag": "38122c0f-dd5b-474a-bd39-f20d490b5a6f"}, {"name": "network-changed", "server_uuid": "d4c0d07e-f0f7-4abf-b406-39e4c0870f54", "tag": "94520acc-41df-40eb-bec9-b1c1e5e125c5"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:45.044486 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-f93ac195-de83-47b6-a624-831fb6b723bc req-06097578-9018-44ae-bd55-84cfa73cd89b service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:45.045228 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-f93ac195-de83-47b6-a624-831fb6b723bc req-06097578-9018-44ae-bd55-84cfa73cd89b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:45.045647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-f93ac195-de83-47b6-a624-831fb6b723bc req-06097578-9018-44ae-bd55-84cfa73cd89b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:45.058513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-f93ac195-de83-47b6-a624-831fb6b723bc req-06097578-9018-44ae-bd55-84cfa73cd89b service nova] Creating event network-changed:38122c0f-dd5b-474a-bd39-f20d490b5a6f for instance 292814e8-5ed9-4973-beb5-106bb39d79d8 on hv-cinder-81574 Aug 30 01:00:45.059034 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-f93ac195-de83-47b6-a624-831fb6b723bc req-06097578-9018-44ae-bd55-84cfa73cd89b service nova] Creating event network-changed:94520acc-41df-40eb-bec9-b1c1e5e125c5 for instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 on hv-cinder-81574 Aug 30 01:00:45.066600 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-f93ac195-de83-47b6-a624-831fb6b723bc req-06097578-9018-44ae-bd55-84cfa73cd89b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035947 Aug 30 01:00:45.067409 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 305/612] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:00:45.259144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:00:45.259569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:00:45.260041 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:00:45.260411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:00:45.261050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:00:45.270970 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:45.271472 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:45.272105 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:45.273063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:45.273519 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:45.273944 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:45.292411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Getting quotas for project 7e919c196d074b8989b4719267ce24f8. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:00:45.296789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Getting quotas for user 22f11e29c4ad4712a54877b0895d28a4 and project 7e919c196d074b8989b4719267ce24f8. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:00:45.308585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:00:45.311873 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:00:45.363883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fdfbaa70-497a-4fb4-b066-cdab53591d87 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.673284 Aug 30 01:00:45.364699 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 308/613] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:00:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:00:45.375996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f84ec26b-690a-45bf-b747-6705327321bf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:45.376665 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f84ec26b-690a-45bf-b747-6705327321bf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:45.477288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f84ec26b-690a-45bf-b747-6705327321bf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:45.509153 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f84ec26b-690a-45bf-b747-6705327321bf tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1238 microversion: 2.1 time: 0.137277 Aug 30 01:00:45.509743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 306/614] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:45 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1238 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:46.003385 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:46.005655 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:46.013664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:46.015050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:46.015688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:46.016516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:46.017129 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:46.017714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:46.053078 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1a39b7ad-94ae-4635-8fc4-1d0eaae12b68 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054640 Aug 30 01:00:46.053814 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 309/615] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:00:45 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:00:46.065643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:46.066262 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:46.072463 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:46.073006 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:46.073501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:46.074293 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:46.074765 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:46.075211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:46.156284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] HTTP exception thrown: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 is not attached to volume 21d88adb-a569-4f97-a848-c4281351d2a0 Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Request method failure captured: Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: DELETE /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments/21d88adb-a569-4f97-a848-c4281351d2a0 HTTP/1.1 Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWB9sUKGmnT3sIfMPidvTOW5zr-rMwgnyetw3ANPilaQDSNg2ELkRRE6zwb9v5I-5tP8tXEnffmaDC-rYwjsRHEhMx4mO1a-oJuw-ZWLzaAZigdmFQAD0Dq7WVqHMLk2gblsiGwdBcT6EM_s9NvrNB8LZOJRpPmpDOW33yYEBqHxlvw Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 0113bd01866148a19268a30e6e76d4dc Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-TestMinimumBasicScenario-1767280054 Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:00:46.165035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0113bd01866148a19268a30e6e76d4dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0113bd01866148a19268a30e6e76d4dc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0113bd01866148a19268a30e6e76d4dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0113bd01866148a19268a30e6e76d4dc"}]}] Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-TestMinimumBasicScenario-1767280054 Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 0113bd01866148a19268a30e6e76d4dc Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1767280054 Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-TestMinimumBasicScenario-1767280054-project Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: b0905e37ac4643b793e1a8d32938479d Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-TestMinimumBasicScenario-1767280054-project Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:00:46.166498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 is not attached to volume 21d88adb-a569-4f97-a848-c4281351d2a0 Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'server_id': 'd4c0d07e-f0f7-4abf-b406-39e4c0870f54', 'id': '21d88adb-a569-4f97-a848-c4281351d2a0'} Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 21d88adb-a569-4f97-a848-c4281351d2a0. Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:00:46.167327 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 is not attached to volume 21d88adb-a569-4f97-a848-c4281351d2a0 Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 is not attached to volume 21d88adb-a569-4f97-a848-c4281351d2a0 Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:46.168719 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Returning 404 to user: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 is not attached to volume 21d88adb-a569-4f97-a848-c4281351d2a0 {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:00:46.169834 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-96bf057e-622a-47a3-b7de-f16fb6a6132c tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments/21d88adb-a569-4f97-a848-c4281351d2a0" status: 404 len: 154 microversion: 2.1 time: 0.106699 Aug 30 01:00:46.169834 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 307/616] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:00:46 2022] DELETE /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54/os-volume_attachments/21d88adb-a569-4f97-a848-c4281351d2a0 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:00:46.533499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:46.534206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:46.536852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:46.545178 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:46.545887 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:46.546300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:46.546994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:46.547461 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:46.547883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:46.621946 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:46.629763 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c4e67a44-e20d-4c54-95fc-12fe6a8f825c tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1290 microversion: 2.1 time: 0.102530 Aug 30 01:00:46.630380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 310/617] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:46 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:47.319172 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:47.319772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:47.326398 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:47.326888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:47.327347 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:47.328042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:47.328474 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:47.328901 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:47.354106 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:00:47.441221 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a7da8f35-a3ff-4e49-bac9-7760f4aa6908 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 204 len: 0 microversion: 2.1 time: 0.125459 Aug 30 01:00:47.443200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 308/618] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:00:47 2022] DELETE /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:00:47.451674 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:47.453148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:47.459805 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:47.460296 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:47.460838 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:47.461729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:47.462320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:47.462931 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:47.653206 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:47.654930 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:47.661971 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:47.662552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:47.663157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:47.663876 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:47.664540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:47.665060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:47.676396 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:47.680209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:47.686814 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1c8f8c15-9381-4ae9-a95c-de841722644e tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1555 microversion: 2.1 time: 0.238320 Aug 30 01:00:47.688027 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 311/619] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:47 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:47.841787 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:47.849894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-843ed4ba-ac60-408c-bd6f-c748e329a5dd tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1364 microversion: 2.1 time: 0.202665 Aug 30 01:00:47.856821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 309/620] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:47 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:48.713073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:48.713925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:48.726007 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:48.726861 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:48.727665 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:48.728933 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:48.729715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:48.730432 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:48.867849 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:48.873601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:48.874201 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:48.877051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8dc098f4-0f63-4eb3-96e3-b3d984d560e9 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1555 microversion: 2.1 time: 0.171316 Aug 30 01:00:48.877798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 312/621] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:48 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:48.881247 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:48.881724 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:48.882158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:48.882849 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:48.883325 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:48.883744 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:49.044542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:49.052919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-423213d7-4e5c-43cd-a402-2fa7042bb4f1 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1364 microversion: 2.1 time: 0.183046 Aug 30 01:00:49.053121 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 310/622] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:48 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:00:49.831342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-b36e5d5d-00a3-4771-97d9-06b689f039ba req-9146afa3-48a6-4013-b7c9-f7c38fc9f9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4c0d07e-f0f7-4abf-b406-39e4c0870f54", "name": "network-vif-deleted", "tag": "94520acc-41df-40eb-bec9-b1c1e5e125c5"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:49.842806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b36e5d5d-00a3-4771-97d9-06b689f039ba req-9146afa3-48a6-4013-b7c9-f7c38fc9f9cb service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:49.843568 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b36e5d5d-00a3-4771-97d9-06b689f039ba req-9146afa3-48a6-4013-b7c9-f7c38fc9f9cb service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:49.844175 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b36e5d5d-00a3-4771-97d9-06b689f039ba req-9146afa3-48a6-4013-b7c9-f7c38fc9f9cb service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:49.858406 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-b36e5d5d-00a3-4771-97d9-06b689f039ba req-9146afa3-48a6-4013-b7c9-f7c38fc9f9cb service nova] Creating event network-vif-deleted:94520acc-41df-40eb-bec9-b1c1e5e125c5 for instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 on hv-cinder-81574 Aug 30 01:00:49.863974 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-b36e5d5d-00a3-4771-97d9-06b689f039ba req-9146afa3-48a6-4013-b7c9-f7c38fc9f9cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036457 Aug 30 01:00:49.864582 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 313/623] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:49.898346 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:49.898960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:49.905849 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:49.906337 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:49.906752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:49.907473 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:49.908101 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:49.908523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:49.919291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-fe176a33-753c-4e70-abf3-f5b6af5cf7c0 req-d4837cb1-1218-43bb-bfe3-d372a3695d31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4af42e2-b719-447c-9ca5-5d9c7318ae25", "tag": "790719ad-0265-4bf6-b00c-4368bb0a354e"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:49.932241 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-fe176a33-753c-4e70-abf3-f5b6af5cf7c0 req-d4837cb1-1218-43bb-bfe3-d372a3695d31 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:49.933005 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-fe176a33-753c-4e70-abf3-f5b6af5cf7c0 req-d4837cb1-1218-43bb-bfe3-d372a3695d31 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:49.933612 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-fe176a33-753c-4e70-abf3-f5b6af5cf7c0 req-d4837cb1-1218-43bb-bfe3-d372a3695d31 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:49.946656 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-fe176a33-753c-4e70-abf3-f5b6af5cf7c0 req-d4837cb1-1218-43bb-bfe3-d372a3695d31 service nova] Creating event network-changed:790719ad-0265-4bf6-b00c-4368bb0a354e for instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 on hv-cinder-81574 Aug 30 01:00:49.951623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-fe176a33-753c-4e70-abf3-f5b6af5cf7c0 req-d4837cb1-1218-43bb-bfe3-d372a3695d31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036556 Aug 30 01:00:49.953339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 314/624] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:00:50.021666 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0905e37ac4643b793e1a8d32938479d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0113bd01866148a19268a30e6e76d4dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:50.030319 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3d9f5d5a-d238-4f4f-a1a5-7dc6bda28240 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 200 len: 1343 microversion: 2.1 time: 0.136312 Aug 30 01:00:50.030872 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 311/625] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:49 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 1343 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:50.074207 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:50.075041 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:50.081604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:50.082082 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:50.082785 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:50.083501 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:50.083951 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:50.084370 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:50.265767 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:50.273838 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d2abe01e-7ce1-4bde-8bdb-5acc36624da5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1364 microversion: 2.1 time: 0.204049 Aug 30 01:00:50.274416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 315/626] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:50 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:51.053074 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:51.053808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] [instance: d4c0d07e-f0f7-4abf-b406-39e4c0870f54] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:51.062408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:51.063043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:51.063578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:51.064431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:51.064991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:51.065490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:51.081333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] HTTP exception thrown: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 could not be found. Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Request method failure captured: Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 HTTP/1.1 Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWB9sUKGmnT3sIfMPidvTOW5zr-rMwgnyetw3ANPilaQDSNg2ELkRRE6zwb9v5I-5tP8tXEnffmaDC-rYwjsRHEhMx4mO1a-oJuw-ZWLzaAZigdmFQAD0Dq7WVqHMLk2gblsiGwdBcT6EM_s9NvrNB8LZOJRpPmpDOW33yYEBqHxlvw Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 0113bd01866148a19268a30e6e76d4dc Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-TestMinimumBasicScenario-1767280054 Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:00:51.082945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0113bd01866148a19268a30e6e76d4dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0113bd01866148a19268a30e6e76d4dc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0113bd01866148a19268a30e6e76d4dc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0113bd01866148a19268a30e6e76d4dc"}]}] Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-TestMinimumBasicScenario-1767280054 Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 0113bd01866148a19268a30e6e76d4dc Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1767280054 Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-TestMinimumBasicScenario-1767280054-project Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: b0905e37ac4643b793e1a8d32938479d Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-TestMinimumBasicScenario-1767280054-project Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 could not be found. Aug 30 01:00:51.084437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'd4c0d07e-f0f7-4abf-b406-39e4c0870f54'} Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 could not be found. Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:00:51.085279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 could not be found. Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 could not be found. Aug 30 01:00:51.086764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:00:51.088304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Returning 404 to user: Instance d4c0d07e-f0f7-4abf-b406-39e4c0870f54 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:00:51.088304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f6619625-96b6-44cc-aaff-87bbb1c1be80 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54" status: 404 len: 111 microversion: 2.1 time: 0.036280 Aug 30 01:00:51.088304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 312/627] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:51 2022] GET /compute/v2.1/servers/d4c0d07e-f0f7-4abf-b406-39e4c0870f54 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:00:51.093573 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3a6f93d2-c4d5-45dd-aaf8-3c519b104169 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] Calling method '.version_select at 0x7f03a1e7d9d0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:51.114767 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3a6f93d2-c4d5-45dd-aaf8-3c519b104169 tempest-TestMinimumBasicScenario-1767280054 tempest-TestMinimumBasicScenario-1767280054-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1346908049" status: 202 len: 0 microversion: 2.1 time: 0.025329 Aug 30 01:00:51.115399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 316/628] 10.222.0.17 () {58 vars in 1272 bytes} [Tue Aug 30 01:00:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1346908049 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:00:51.295256 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:51.295859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:51.302199 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:51.302722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:51.303207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:51.303841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:51.304290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:51.304709 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:51.447157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:51.455367 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-aa032009-4c14-49ba-9e53-eafbfbab1b9e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1364 microversion: 2.1 time: 0.164233 Aug 30 01:00:51.455988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 313/629] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:51 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:52.476799 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:52.477371 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:52.484809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:52.485294 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:52.485719 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:52.486411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:52.486871 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:52.487307 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:52.626544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:52.635738 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-50a43b92-0212-4043-a952-7fa52f58f216 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1364 microversion: 2.1 time: 0.163452 Aug 30 01:00:52.636297 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 317/630] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:52 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:53.663043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:53.663677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:53.672559 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:53.673133 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:53.673637 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:53.674475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:53.674995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:53.675513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:53.818629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:53.826721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-32b6bd8f-1739-4a90-a565-0a6d2d3e9dd3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1364 microversion: 2.1 time: 0.174026 Aug 30 01:00:53.827938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 314/631] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:53 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:54.847458 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:54.848683 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:54.855389 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:54.855873 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:54.856307 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:54.857014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:54.857469 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:54.858006 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:54.993055 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:55.001326 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-92a47020-3405-4c39-93d2-b6aa2a3a1712 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1364 microversion: 2.1 time: 0.157904 Aug 30 01:00:55.001934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 318/632] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:54 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:55.577321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-4bd9b749-b894-44d4-b3f1-4bbda6b12667 req-f30c167c-140f-4b7d-ae70-17e46c900ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4af42e2-b719-447c-9ca5-5d9c7318ae25", "name": "network-vif-plugged", "status": "completed", "tag": "790719ad-0265-4bf6-b00c-4368bb0a354e"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:55.590066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:55.591312 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:55.594736 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-4bd9b749-b894-44d4-b3f1-4bbda6b12667 req-f30c167c-140f-4b7d-ae70-17e46c900ce2 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:55.596240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-4bd9b749-b894-44d4-b3f1-4bbda6b12667 req-f30c167c-140f-4b7d-ae70-17e46c900ce2 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:55.597654 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-4bd9b749-b894-44d4-b3f1-4bbda6b12667 req-f30c167c-140f-4b7d-ae70-17e46c900ce2 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:55.615841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-4bd9b749-b894-44d4-b3f1-4bbda6b12667 req-f30c167c-140f-4b7d-ae70-17e46c900ce2 service nova] Creating event network-vif-plugged:790719ad-0265-4bf6-b00c-4368bb0a354e for instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 on hv-cinder-81574 Aug 30 01:00:55.622706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-4bd9b749-b894-44d4-b3f1-4bbda6b12667 req-f30c167c-140f-4b7d-ae70-17e46c900ce2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049414 Aug 30 01:00:55.628500 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 315/633] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:56.022512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:56.023136 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:56.025186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:56.025862 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:00:56.033010 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:56.033500 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:56.033934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:56.034625 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:56.035087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:56.035516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:56.178775 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:56.191831 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-641cf424-39c0-4d2a-b50a-d946bb0c6013 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1364 microversion: 2.1 time: 0.173263 Aug 30 01:00:56.193021 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 319/634] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:56 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:57.216902 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:57.218075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:57.226057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:57.226483 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:57.226888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:57.227631 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:57.228125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:57.228482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:57.378110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:00:57.386352 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ae38c3c0-3410-4035-9a92-639fa52c2ef4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1548 microversion: 2.1 time: 0.176066 Aug 30 01:00:57.391474 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 316/635] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:00:57 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:00:57.407376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:00:57.407937 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:00:57.419674 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:57.420206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:57.420639 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:57.421563 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:57.422132 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:57.422710 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:57.514907 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-466b785a-c8a1-4c33-ba32-631d78f78e7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111880 Aug 30 01:00:57.522565 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 320/636] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 30 01:00:57 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:00:59.229182 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-2850ac4b-a9f9-4cad-bffd-477282f0aca5 req-1cca5daf-1424-4952-9c13-369b30312bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4af42e2-b719-447c-9ca5-5d9c7318ae25", "tag": "790719ad-0265-4bf6-b00c-4368bb0a354e"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:00:59.239793 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-2850ac4b-a9f9-4cad-bffd-477282f0aca5 req-1cca5daf-1424-4952-9c13-369b30312bc5 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:00:59.240772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-2850ac4b-a9f9-4cad-bffd-477282f0aca5 req-1cca5daf-1424-4952-9c13-369b30312bc5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:00:59.241306 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-2850ac4b-a9f9-4cad-bffd-477282f0aca5 req-1cca5daf-1424-4952-9c13-369b30312bc5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:00:59.253754 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-2850ac4b-a9f9-4cad-bffd-477282f0aca5 req-1cca5daf-1424-4952-9c13-369b30312bc5 service nova] Creating event network-changed:790719ad-0265-4bf6-b00c-4368bb0a354e for instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 on hv-cinder-81574 Aug 30 01:00:59.259091 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-2850ac4b-a9f9-4cad-bffd-477282f0aca5 req-1cca5daf-1424-4952-9c13-369b30312bc5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033926 Aug 30 01:00:59.260115 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 317/637] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:04.853319 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:04.853873 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:04.860468 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:04.860968 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:04.861394 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:04.862079 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:04.862517 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:04.862929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:04.945574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lazy-loading 'services' on Instance uuid ac33e3d7-0988-43ef-be96-21ad64b2825a {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:01:05.072705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-16727492-c347-4d34-8ff3-c1e8ab6ed6af tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments/80503df4-9914-49ce-88da-a7e049ce277b" status: 202 len: 0 microversion: 2.1 time: 0.223831 Aug 30 01:01:05.073367 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 321/638] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:01:04 2022] DELETE /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments/80503df4-9914-49ce-88da-a7e049ce277b => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:01:05.084355 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:05.086748 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:05.093914 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:05.094533 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:05.094999 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:05.095828 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:05.096277 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:05.096710 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:05.128751 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:05.134374 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-de8fa4c0-7746-41e7-bcf1-20f557f441a1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055831 Aug 30 01:01:05.134934 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 318/639] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:01:05 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:01:06.152488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:06.155738 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:06.163479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:06.164025 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:06.164512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:06.165286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:06.165794 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:06.166251 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:06.199223 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0678408d-870a-481a-81cb-5a8d6f51e707 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054321 Aug 30 01:01:06.199784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 322/640] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:01:06 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:01:06.287894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:06.288457 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:06.296341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:06.296814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:06.297244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:06.297933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:06.298380 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:06.298798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:06.326759 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:01:06.416685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ff9b3a85-98bf-4886-b830-855b406ba12e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 204 len: 0 microversion: 2.1 time: 0.132385 Aug 30 01:01:06.417235 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 319/641] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:01:06 2022] DELETE /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:01:06.426693 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:06.427314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:06.433395 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:06.433868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:06.434305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:06.435387 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:06.435928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:06.436405 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:06.589324 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:06.597681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-107a1f08-7e0a-45e5-9b35-a391ad34d3e8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1689 microversion: 2.1 time: 0.174808 Aug 30 01:01:06.598246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 323/642] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:06 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:07.620074 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:07.620783 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:07.627722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:07.628202 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:07.628628 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:07.629313 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:07.629760 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:07.630174 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:07.764564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:07.773469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9447cc1b-a525-4460-b0ad-d62a5ea81a5d tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1689 microversion: 2.1 time: 0.158026 Aug 30 01:01:07.774048 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 320/643] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:07 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:08.797868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:08.798478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:08.808109 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:08.808766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:08.809366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:08.810702 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:08.811304 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:08.811879 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:08.949181 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:08.958844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-23cfa654-0af4-457a-9bd7-9bc7e72f9a30 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1689 microversion: 2.1 time: 0.167369 Aug 30 01:01:08.959435 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 324/644] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:08 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:09.979407 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:09.980072 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:09.987187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:09.987671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:09.988109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:09.988804 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:09.989255 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:09.989681 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:10.158606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:10.166444 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-11e95ae3-21c9-4f5c-b41c-8c6293d40337 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1689 microversion: 2.1 time: 0.191006 Aug 30 01:01:10.167027 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 321/645] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:09 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:11.063352 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-54c19f64-2fdd-44fb-9280-9b997eb927b7 req-e2b8d093-9877-4c38-889d-e1c83a096073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac33e3d7-0988-43ef-be96-21ad64b2825a", "name": "network-vif-deleted", "tag": "b9464aee-4ec1-4b42-9b48-87dd1b038f79"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:11.073385 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-54c19f64-2fdd-44fb-9280-9b997eb927b7 req-e2b8d093-9877-4c38-889d-e1c83a096073 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:11.073860 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-54c19f64-2fdd-44fb-9280-9b997eb927b7 req-e2b8d093-9877-4c38-889d-e1c83a096073 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:11.074902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-54c19f64-2fdd-44fb-9280-9b997eb927b7 req-e2b8d093-9877-4c38-889d-e1c83a096073 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:11.088798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-54c19f64-2fdd-44fb-9280-9b997eb927b7 req-e2b8d093-9877-4c38-889d-e1c83a096073 service nova] Creating event network-vif-deleted:b9464aee-4ec1-4b42-9b48-87dd1b038f79 for instance ac33e3d7-0988-43ef-be96-21ad64b2825a on hv-cinder-81574 Aug 30 01:01:11.094230 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-54c19f64-2fdd-44fb-9280-9b997eb927b7 req-e2b8d093-9877-4c38-889d-e1c83a096073 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034984 Aug 30 01:01:11.094826 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 325/646] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:11.188743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:11.189230 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:11.200911 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:11.201405 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:11.201846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:11.202562 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:11.203064 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:11.203458 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:11.247374 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:11.248251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:11.248894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:11.249575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lazy-loading 'fault' on Instance uuid ac33e3d7-0988-43ef-be96-21ad64b2825a {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:01:11.298818 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:11.306880 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7db190fa-87d8-42b8-819a-d2c4cfca70e1 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 200 len: 1335 microversion: 2.1 time: 0.123031 Aug 30 01:01:11.307923 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 322/647] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:11 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 1335 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:12.328972 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:12.329717 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: ac33e3d7-0988-43ef-be96-21ad64b2825a] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:12.336705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:12.337182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:12.337609 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:12.338295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:12.338739 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:12.339188 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:12.353167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] HTTP exception thrown: Instance ac33e3d7-0988-43ef-be96-21ad64b2825a could not be found. Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Request method failure captured: Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a HTTP/1.1 Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAZpwyg9_G7AFFXS_OTfo4jGYZHLvDJxY10FKJse4IyrqcRBKpZqfMUSTKUkO9jHIkzmwXlscxzwH_YQ7QqOLBbSVkYFjeKnXhqemnA7NlggBOZVflK3tbm569mlkgNPSL1T9so-ZOeqSMTQsTpNomQYJLwFCr4K_oT1abJ4reU11o Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:01:12.354804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a1cf0a235aa4669a9276c293a78f2eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}] Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 1d1c13089bd14d48ba637468182eee14 Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance ac33e3d7-0988-43ef-be96-21ad64b2825a could not be found. Aug 30 01:01:12.356354 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': 'ac33e3d7-0988-43ef-be96-21ad64b2825a'} Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac33e3d7-0988-43ef-be96-21ad64b2825a could not be found. Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:12.357266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac33e3d7-0988-43ef-be96-21ad64b2825a could not be found. Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac33e3d7-0988-43ef-be96-21ad64b2825a could not be found. Aug 30 01:01:12.358581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:12.359925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Returning 404 to user: Instance ac33e3d7-0988-43ef-be96-21ad64b2825a could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:12.359925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-963602ec-8e79-4859-9836-e7ab6c6f1139 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a" status: 404 len: 111 microversion: 2.1 time: 0.032133 Aug 30 01:01:12.359925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 326/648] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:12 2022] GET /compute/v2.1/servers/ac33e3d7-0988-43ef-be96-21ad64b2825a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:01:12.365292 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-74730540-0fd7-41b9-838c-c0c1498beb21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '.version_select at 0x7f03a1d41820>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:12.386657 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-74730540-0fd7-41b9-838c-c0c1498beb21 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459089252" status: 202 len: 0 microversion: 2.1 time: 0.025196 Aug 30 01:01:12.387254 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 323/649] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 30 01:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459089252 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:01:15.305380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:15.305908 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:15.312970 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:15.313444 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:15.313953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:15.315018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:15.315480 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:15.315897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:15.342197 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:01:15.431767 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ed9e4c51-61b9-46a0-bcae-24dd9e33a054 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 204 len: 0 microversion: 2.1 time: 0.129262 Aug 30 01:01:15.432585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 327/650] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:01:15 2022] DELETE /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:01:15.446247 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:15.447210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:15.455765 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:15.456252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:15.456897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:15.457903 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:15.458457 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:15.458999 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:15.595554 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:15.603758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-83ee8d16-a62a-428d-af47-3935674aaf4e tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1507 microversion: 2.1 time: 0.164713 Aug 30 01:01:15.604316 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 324/651] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:15 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:16.626471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:16.627149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:16.629583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:16.634916 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:16.635444 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:16.635864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:16.636604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:16.637022 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:16.637442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:16.804038 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:16.816416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-aac72700-02c7-47ce-9bb1-5a45737fd669 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1507 microversion: 2.1 time: 0.194719 Aug 30 01:01:16.816990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 328/652] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:16 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:17.839708 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:17.840595 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:17.850583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:17.851300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:17.851938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:17.852959 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:17.853611 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:17.854183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:17.995837 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:18.003784 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ba508597-5f35-4296-80e7-b34870aa3878 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1507 microversion: 2.1 time: 0.169621 Aug 30 01:01:18.004338 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 325/653] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:17 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:18.512109 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-d2ccf207-c90e-4b71-9f6d-feca8e60e870 req-91394b90-4d9b-44e9-93c9-d97bc83a4a2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bceb6b40-b276-45b3-a56a-9bc07784ac8c", "name": "network-vif-deleted", "tag": "af8730c7-2165-4ad5-b19f-0e9f6e424802"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:18.522420 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d2ccf207-c90e-4b71-9f6d-feca8e60e870 req-91394b90-4d9b-44e9-93c9-d97bc83a4a2d service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:18.522892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d2ccf207-c90e-4b71-9f6d-feca8e60e870 req-91394b90-4d9b-44e9-93c9-d97bc83a4a2d service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:18.523336 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d2ccf207-c90e-4b71-9f6d-feca8e60e870 req-91394b90-4d9b-44e9-93c9-d97bc83a4a2d service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:18.535120 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-d2ccf207-c90e-4b71-9f6d-feca8e60e870 req-91394b90-4d9b-44e9-93c9-d97bc83a4a2d service nova] Creating event network-vif-deleted:af8730c7-2165-4ad5-b19f-0e9f6e424802 for instance bceb6b40-b276-45b3-a56a-9bc07784ac8c on hv-cinder-81574 Aug 30 01:01:18.540310 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-d2ccf207-c90e-4b71-9f6d-feca8e60e870 req-91394b90-4d9b-44e9-93c9-d97bc83a4a2d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177791 Aug 30 01:01:18.540872 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 329/654] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:19.025045 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:19.025627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:19.032872 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:19.033386 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:19.033814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:19.034511 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:19.034966 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:19.035419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:19.070616 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:19.071128 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:19.071562 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:19.072000 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lazy-loading 'fault' on Instance uuid bceb6b40-b276-45b3-a56a-9bc07784ac8c {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:01:19.118020 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:19.125326 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5e94f9d0-177d-4148-8234-24747b24aadc tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 200 len: 1311 microversion: 2.1 time: 0.105122 Aug 30 01:01:19.125884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 326/655] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:19 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:19.374529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:19.375157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:19.381898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:19.382371 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:19.382790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:19.383649 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:19.384110 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:19.384527 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:19.387123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:19.412462 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-26f79332-b307-4e74-8547-bbb68a2c626e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/ips" status: 200 len: 152 microversion: 2.20 time: 0.152678 Aug 30 01:01:19.413052 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 330/656] 10.222.0.17 () {60 vars in 1289 bytes} [Tue Aug 30 01:01:19 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/ips => generated 152 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:01:20.147601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:20.148190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: bceb6b40-b276-45b3-a56a-9bc07784ac8c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:20.154950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:20.155456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:20.155884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:20.156566 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:20.157012 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:20.157433 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:20.172709 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] HTTP exception thrown: Instance bceb6b40-b276-45b3-a56a-9bc07784ac8c could not be found. Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Request method failure captured: Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c HTTP/1.1 Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAZpwyg9_G7AFFXS_OTfo4jGYZHLvDJxY10FKJse4IyrqcRBKpZqfMUSTKUkO9jHIkzmwXlscxzwH_YQ7QqOLBbSVkYFjeKnXhqemnA7NlggBOZVflK3tbm569mlkgNPSL1T9so-ZOeqSMTQsTpNomQYJLwFCr4K_oT1abJ4reU11o Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:01:20.174339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a1cf0a235aa4669a9276c293a78f2eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}] Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 1d1c13089bd14d48ba637468182eee14 Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance bceb6b40-b276-45b3-a56a-9bc07784ac8c could not be found. Aug 30 01:01:20.175798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'bceb6b40-b276-45b3-a56a-9bc07784ac8c'} Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bceb6b40-b276-45b3-a56a-9bc07784ac8c could not be found. Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:20.176692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bceb6b40-b276-45b3-a56a-9bc07784ac8c could not be found. Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bceb6b40-b276-45b3-a56a-9bc07784ac8c could not be found. Aug 30 01:01:20.178779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:01:20.180160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Returning 404 to user: Instance bceb6b40-b276-45b3-a56a-9bc07784ac8c could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:20.180160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3452c1ff-0fa0-4523-8e0f-a17dc5a28e37 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c" status: 404 len: 111 microversion: 2.1 time: 0.032458 Aug 30 01:01:20.180160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 327/657] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:20 2022] GET /compute/v2.1/servers/bceb6b40-b276-45b3-a56a-9bc07784ac8c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:01:20.185552 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:20.186153 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:20.192434 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:20.192909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:20.193366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:20.194089 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:20.194539 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:20.194954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:20.224268 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:01:20.323753 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-18710f8b-2993-40a8-93d6-dd40ad811623 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 204 len: 0 microversion: 2.1 time: 0.142152 Aug 30 01:01:20.324385 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 331/658] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:01:20 2022] DELETE /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 01:01:20.334855 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:20.335484 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:20.341703 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:20.342161 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:20.342592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:20.343379 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:20.343825 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:20.344239 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:20.485266 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:20.498703 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-639b01b0-1e41-4307-b76a-8b33198e30bb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.167874 Aug 30 01:01:20.499464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 328/659] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:20 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:21.521657 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:21.522467 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:21.529895 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:21.530374 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:21.530810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:21.531707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:21.532148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:21.532564 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:21.677569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:21.686521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2554a8ac-a151-49e0-acbe-71d6de1eb81c tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.169182 Aug 30 01:01:21.687088 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 332/660] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:21 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:22.063558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:22.064168 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:22.071186 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:22.071662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:22.072088 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:22.072799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:22.073244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:22.073682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:22.096815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lazy-loading 'flavor' on Instance uuid 292814e8-5ed9-4973-beb5-106bb39d79d8 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:01:22.305303 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-11ab12a6-8ffc-440f-9828-001999af91a5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/action" status: 202 len: 0 microversion: 2.20 time: 0.246216 Aug 30 01:01:22.305891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 329/661] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 30 01:01:22 2022] POST /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:01:22.315764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:22.316291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:22.322931 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:22.323461 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:22.323892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:22.324594 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:22.325045 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:22.325466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:22.471914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:22.483331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:22.484766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:22.485951 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9db86588-8db9-4dd6-99b3-7ba96a77da19 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.174184 Aug 30 01:01:22.486520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 333/662] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:22 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:22.711271 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:22.712424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:22.721041 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:22.721816 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:22.722531 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:22.723670 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:22.724403 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:22.725124 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:22.876148 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:22.886183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c3ab47dd-c417-4fe8-a6e9-14279ef73744 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1520 microversion: 2.1 time: 0.181091 Aug 30 01:01:22.886752 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 330/663] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:22 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:23.509407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:23.510072 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:23.516756 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:23.517323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:23.517812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:23.518556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:23.519064 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:23.519527 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:23.652532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:23.661010 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:23.662435 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:23.663898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-29f7454c-fed1-4e77-af02-f8fa1705dc08 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.158660 Aug 30 01:01:23.664454 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 334/664] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:23 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:23.777942 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-a5ee2242-2ea9-42cb-9622-a4330700e485 req-ba2f8bf2-441b-46b1-bb1d-3a5e41aea9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56c98ec-9fce-4594-ae20-a22df2e99af4", "name": "network-vif-deleted", "tag": "abfddcc0-2d9f-4dcd-befd-77d9702397c7"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:23.789517 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a5ee2242-2ea9-42cb-9622-a4330700e485 req-ba2f8bf2-441b-46b1-bb1d-3a5e41aea9fe service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:23.789985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a5ee2242-2ea9-42cb-9622-a4330700e485 req-ba2f8bf2-441b-46b1-bb1d-3a5e41aea9fe service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:23.790525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a5ee2242-2ea9-42cb-9622-a4330700e485 req-ba2f8bf2-441b-46b1-bb1d-3a5e41aea9fe service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:23.802362 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-a5ee2242-2ea9-42cb-9622-a4330700e485 req-ba2f8bf2-441b-46b1-bb1d-3a5e41aea9fe service nova] Creating event network-vif-deleted:abfddcc0-2d9f-4dcd-befd-77d9702397c7 for instance d56c98ec-9fce-4594-ae20-a22df2e99af4 on hv-cinder-81574 Aug 30 01:01:23.807439 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-a5ee2242-2ea9-42cb-9622-a4330700e485 req-ba2f8bf2-441b-46b1-bb1d-3a5e41aea9fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033199 Aug 30 01:01:23.808052 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 331/665] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:23.907431 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:23.908237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:23.916998 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:23.917485 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:23.917898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:23.918592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:23.919053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:23.919492 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:23.957314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:23.957797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:23.958251 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:23.958696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lazy-loading 'fault' on Instance uuid d56c98ec-9fce-4594-ae20-a22df2e99af4 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:01:24.013711 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d1c13089bd14d48ba637468182eee14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1cf0a235aa4669a9276c293a78f2eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:24.024124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0a451827-c070-4251-957a-fcc59116e3a8 tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 200 len: 1311 microversion: 2.1 time: 0.120352 Aug 30 01:01:24.024471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 335/666] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:23 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:24.691469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:24.692659 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:24.703635 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:24.704528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:24.705407 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:24.706565 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:24.707364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:24.708068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:24.857210 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:24.870015 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:24.872415 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:24.874208 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a002d584-f752-497b-b64f-d86336ba0913 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.190017 Aug 30 01:01:24.875102 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 332/667] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:24 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:25.051548 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:25.052373 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] [instance: d56c98ec-9fce-4594-ae20-a22df2e99af4] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:25.063596 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:25.064403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:25.065265 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:25.066430 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:25.067403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:25.068125 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:25.083669 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] HTTP exception thrown: Instance d56c98ec-9fce-4594-ae20-a22df2e99af4 could not be found. Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Request method failure captured: Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 HTTP/1.1 Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAZpwyg9_G7AFFXS_OTfo4jGYZHLvDJxY10FKJse4IyrqcRBKpZqfMUSTKUkO9jHIkzmwXlscxzwH_YQ7QqOLBbSVkYFjeKnXhqemnA7NlggBOZVflK3tbm569mlkgNPSL1T9so-ZOeqSMTQsTpNomQYJLwFCr4K_oT1abJ4reU11o Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:01:25.085547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9a1cf0a235aa4669a9276c293a78f2eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9a1cf0a235aa4669a9276c293a78f2eb"}]}] Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 9a1cf0a235aa4669a9276c293a78f2eb Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1473995853 Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 1d1c13089bd14d48ba637468182eee14 Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1473995853-project Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance d56c98ec-9fce-4594-ae20-a22df2e99af4 could not be found. Aug 30 01:01:25.087093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': 'd56c98ec-9fce-4594-ae20-a22df2e99af4'} Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d56c98ec-9fce-4594-ae20-a22df2e99af4 could not be found. Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:25.087966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d56c98ec-9fce-4594-ae20-a22df2e99af4 could not be found. Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d56c98ec-9fce-4594-ae20-a22df2e99af4 could not be found. Aug 30 01:01:25.089331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:25.090404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] Returning 404 to user: Instance d56c98ec-9fce-4594-ae20-a22df2e99af4 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:25.090404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1957d3ff-6dcf-407c-924f-4816a4c44bdb tempest-ServerRescueNegativeTestJSON-1473995853 tempest-ServerRescueNegativeTestJSON-1473995853-project] 10.222.0.17 "GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4" status: 404 len: 111 microversion: 2.1 time: 0.041933 Aug 30 01:01:25.090404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 336/668] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:25 2022] GET /compute/v2.1/servers/d56c98ec-9fce-4594-ae20-a22df2e99af4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:01:25.900040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:25.900624 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:25.907746 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:25.908245 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:25.908687 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:25.909389 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:25.909842 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:25.910265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:25.929063 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:26.048192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:26.057124 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:26.058570 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:26.060321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a00f0f3a-0d82-4920-a1ce-e9d7bb52f2aa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.164432 Aug 30 01:01:26.061057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 333/669] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:25 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:27.083658 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:27.084478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:27.091652 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:27.092398 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:27.092893 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:27.093594 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:27.094050 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:27.094469 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:27.308145 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:27.317074 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:27.318588 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:27.319951 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e491c1d3-536d-4223-ae8f-75544c00f172 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.240324 Aug 30 01:01:27.335031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 337/670] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:27 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:28.343039 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:28.343627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:28.347512 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:28.352863 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:28.353392 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:28.353861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:28.355028 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:28.355803 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:28.356386 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:28.634051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:28.643230 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:28.644782 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:28.645970 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b73773d4-33fd-4214-8f75-94669482cb46 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.306924 Aug 30 01:01:28.648559 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 334/671] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:28 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:29.674129 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:29.674763 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:29.682120 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:29.682612 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:29.683127 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:29.683765 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:29.684898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:29.684982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:29.823527 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:29.831812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:29.833247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:29.834838 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-961f124c-9d87-48b2-ade6-cf03aed6864a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.164523 Aug 30 01:01:29.835584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 338/672] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:29 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:30.858951 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:30.859692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:30.867352 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:30.867899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:30.868407 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:30.869163 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:30.869667 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:30.870343 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:31.005272 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:31.014833 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:31.016487 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:31.018032 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-2ceb490c-6376-4eab-9626-35b9f4b15e32 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.163849 Aug 30 01:01:31.018728 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 335/673] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:30 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:32.041715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:32.042300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:32.049025 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:32.049505 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:32.049931 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:32.050627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:32.051095 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:32.051493 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:32.191506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:32.200473 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:32.201885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:32.203252 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fd58596d-3fad-4bc0-9e2c-e1dfcdc7799f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.165738 Aug 30 01:01:32.203892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 339/674] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:32 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:33.226111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:33.226755 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:33.233495 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.233968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.234397 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:33.235123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:33.235565 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:33.235985 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:33.367599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:33.375894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:33.377418 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:33.378616 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3669b5e5-b7f3-46f6-b27b-39b80f61859f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.156673 Aug 30 01:01:33.379206 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 336/675] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:33 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:34.405510 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:34.407351 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:34.416682 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:34.417431 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:34.417568 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:34.418294 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:34.418742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:34.419215 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:34.568521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:34.577201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:34.578619 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:34.579789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-35e0ebdc-e82f-4a35-abf4-30084b4c6b64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.180430 Aug 30 01:01:34.580344 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 340/676] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:34 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:35.606501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:35.607475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:35.616806 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:35.617311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:35.617747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:35.618726 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:35.619222 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:35.619645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:35.768089 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:35.776996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:35.778445 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:35.779672 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7dca12fa-e06a-4558-9c15-7fa47c75a7ff tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.179702 Aug 30 01:01:35.780435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 337/677] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:35 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:36.806584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:36.807182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:36.814229 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.814702 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.815165 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.815851 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:36.816324 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:36.816707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:36.948277 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:36.956554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:36.958019 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:36.959208 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f6fc7d9a-4d0b-42eb-b870-65b1bd078757 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.157994 Aug 30 01:01:36.959768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 341/678] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:36 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:37.070655 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:37.071340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:37.077433 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.077919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.078351 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.079065 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.079572 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.079995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.109162 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-03fb5444-9c6e-4500-abd1-cbf4e63528d5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/ips" status: 200 len: 143 microversion: 2.1 time: 0.219924 Aug 30 01:01:37.109805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 338/679] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 01:01:36 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/ips => generated 143 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:37.984442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:37.985031 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:37.991819 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.992287 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.992710 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:37.993422 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:37.993915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:37.994308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:38.145113 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:38.157745 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:38.159992 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:38.161812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ed6c0786-d4d4-47b9-9ea9-0eba6cdc97fa tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.181108 Aug 30 01:01:38.162587 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 342/680] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:37 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:39.187964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:39.188677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:39.196577 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:39.197360 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:39.197858 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:39.198661 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:39.199214 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:39.199700 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:39.331271 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:39.339791 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:39.341203 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:39.342349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b6d6ae39-be01-4996-8e59-bd9ae08dfe07 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.159432 Aug 30 01:01:39.342909 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 339/681] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:39 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:40.365211 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:40.365827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:40.372822 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.373303 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.373725 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.374480 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.374994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.375411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.515442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:40.527855 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:40.530631 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:40.532486 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fcef7204-6672-4ad3-b3da-1bde6d4c089f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.171010 Aug 30 01:01:40.533296 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 343/682] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:40 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:40.590861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80817292-10c4-494b-bfed-cf0ca967bc2a"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:40.593318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:40.600054 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.600540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.600975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.601668 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:40.602126 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:40.602569 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:40.871507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a497b425-2044-4b08-9a92-579965e010e0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285010 Aug 30 01:01:40.872157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 340/683] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:01:40 2022] POST /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:41.557903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:41.558526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:41.565645 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.566141 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.566749 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.567823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.568368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.568935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.594359 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:41.594359 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:41.600954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.601619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.602155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.603055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.603741 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.604252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.632781 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lazy-loading 'flavor' on Instance uuid 6f572fa1-3226-46e6-9899-4fcf86fd92f1 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:01:41.722281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:41.726931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-247a1ebf-81b2-40a4-8184-8bb38b6b7362 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "POST /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1/action" status: 202 len: 0 microversion: 2.1 time: 0.142994 Aug 30 01:01:41.727824 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 341/684] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 01:01:41 2022] POST /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:01:41.734197 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:41.735734 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:41.736814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:41.736970 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-351f02d7-6fcc-454c-962b-e22b188f2b51 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.183146 Aug 30 01:01:41.746026 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:41.746257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 344/685] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:41 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:41.746381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.746381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.746381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.746381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:41.746733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:41.746828 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:41.904423 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:41.912670 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-37fdad6f-2092-4041-a584-797dd74e3079 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.179674 Aug 30 01:01:41.912904 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 342/686] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:41 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:42.761566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:42.762167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:42.769247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.769806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.770159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.770938 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.771547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.771950 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.912093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:42.914480 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:42.923445 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:42.925096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:42.926440 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a5279533-0459-4fd9-a0da-31040eadc9dc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.168887 Aug 30 01:01:42.927242 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 345/687] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:42 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:42.942810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:42.943583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:42.951693 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.952262 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.953113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:42.954035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:42.954698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:42.955330 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:43.095767 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:43.107221 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f86899d6-89d2-40b8-a116-fddcf6e706b3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.168792 Aug 30 01:01:43.107789 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 343/688] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:42 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:43.950662 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:43.951319 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:43.958716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:43.959253 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:43.959679 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:43.960372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:43.960812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:43.961225 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.112292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.122472 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.123970 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.125206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3cdfba5a-93bf-447a-ae0c-9239111584fc tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1745 microversion: 2.20 time: 0.178639 Aug 30 01:01:44.125751 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 346/689] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:43 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:44.131450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:44.132516 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:44.140216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.140909 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.141503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.142202 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.142651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.143092 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.280668 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.288630 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d9c41c99-e8bf-4e31-8012-8f2659bf7a7b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.162980 Aug 30 01:01:44.289233 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 344/690] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:44 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:44.694526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:44.695115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:44.702483 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.702961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.703423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.704178 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.704629 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.705049 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.730120 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:01:44.810655 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-345ed6f6-66ea-400c-9580-f4dd4beebfea tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 204 len: 0 microversion: 2.1 time: 0.119397 Aug 30 01:01:44.812177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 347/691] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:01:44 2022] DELETE /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:01:44.821039 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:44.821653 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:44.828237 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.828713 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.829143 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.829827 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:44.830275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:44.830691 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:44.976019 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:44.984536 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0923b87e-9c64-4dfc-b79e-db90bba503ad tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1577 microversion: 2.1 time: 0.167568 Aug 30 01:01:44.985108 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 345/692] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:44 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:45.150530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:45.151357 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:45.158682 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.159190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.159618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.160300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.160740 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.161152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.310271 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:45.310867 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:45.316193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:45.322658 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.323182 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.323975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.324684 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.325214 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.325843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:45.326286 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.327601 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:45.328719 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-76fac760-63b2-4f86-aa3c-143e9eb9e7c7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1745 microversion: 2.20 time: 0.183209 Aug 30 01:01:45.329456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 348/693] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:45 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:45.464894 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:45.473189 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c85c7518-44cc-4772-b75e-7467e82ff691 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.167422 Aug 30 01:01:45.473796 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 346/694] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:45 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:45.843583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-14c004df-d9f0-41c0-bbc6-87266b36a3cb req-931f8aa8-2453-4a0a-8d17-3573dfab3e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292814e8-5ed9-4973-beb5-106bb39d79d8", "name": "network-vif-plugged", "status": "completed", "tag": "38122c0f-dd5b-474a-bd39-f20d490b5a6f"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:45.852968 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-14c004df-d9f0-41c0-bbc6-87266b36a3cb req-931f8aa8-2453-4a0a-8d17-3573dfab3e82 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:45.853436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-14c004df-d9f0-41c0-bbc6-87266b36a3cb req-931f8aa8-2453-4a0a-8d17-3573dfab3e82 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:45.853858 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-14c004df-d9f0-41c0-bbc6-87266b36a3cb req-931f8aa8-2453-4a0a-8d17-3573dfab3e82 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:45.865011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-14c004df-d9f0-41c0-bbc6-87266b36a3cb req-931f8aa8-2453-4a0a-8d17-3573dfab3e82 service nova] Creating event network-vif-plugged:38122c0f-dd5b-474a-bd39-f20d490b5a6f for instance 292814e8-5ed9-4973-beb5-106bb39d79d8 on hv-cinder-81574 Aug 30 01:01:45.869834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-14c004df-d9f0-41c0-bbc6-87266b36a3cb req-931f8aa8-2453-4a0a-8d17-3573dfab3e82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095113 Aug 30 01:01:45.870411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 349/695] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:46.010385 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:46.010901 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:46.017849 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.018332 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.018773 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.019496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.019950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.020370 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.024520 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:46.161260 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:46.169523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-351d7bd3-b4f6-4f79-b8c5-692e9b074df9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1577 microversion: 2.1 time: 0.162908 Aug 30 01:01:46.170096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 347/696] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:46 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:46.353106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:46.353809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:46.360874 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.361353 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.361778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.362464 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.362937 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.363387 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.496460 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:46.497743 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:46.500455 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:46.504162 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.504639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.505069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.505764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:46.506211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:46.506626 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:46.509000 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:46.510413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:46.511605 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-acb07d2b-0386-424e-914e-55fc19eaa504 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.162863 Aug 30 01:01:46.512160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 350/697] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:46 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:46.643986 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:46.652040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e05e22e7-a146-4bad-b582-1bf2c12c2779 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.159823 Aug 30 01:01:46.652660 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 348/698] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:46 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:47.195227 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:47.195825 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:47.198295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:47.203642 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.204113 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.204541 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.205228 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.205671 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.206083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.365126 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:47.374793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e04aff8a-a18b-47df-9082-c85a43c35384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1577 microversion: 2.1 time: 0.183400 Aug 30 01:01:47.376278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 351/699] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:47 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:47.536117 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:47.537429 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:47.545844 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.546408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.546912 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.547943 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.548502 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.549070 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.673708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:47.674672 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:47.681703 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.682017 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.682637 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.683805 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:47.684785 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:47.685490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:47.693558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:47.704764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:47.706305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:47.707851 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-93b77280-eba7-470b-89d5-29cacc7da41c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.175998 Aug 30 01:01:47.709354 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 349/700] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:47 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:48.182203 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:48.193559 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-adba515e-6b21-4880-99b7-131c75f19f9e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.523687 Aug 30 01:01:48.208094 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 352/701] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:47 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:48.306595 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-12244ef6-ebe2-4104-b30d-281c52cfe528 req-77f5c74d-f267-4605-b16e-76602bd32778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7f85e9-692b-454e-95f3-5dc087400373", "name": "network-vif-deleted", "tag": "67b64a6a-d7e2-4d07-8bc8-55d834fdb95c"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:48.335692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-12244ef6-ebe2-4104-b30d-281c52cfe528 req-77f5c74d-f267-4605-b16e-76602bd32778 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.352840 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-12244ef6-ebe2-4104-b30d-281c52cfe528 req-77f5c74d-f267-4605-b16e-76602bd32778 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.353457 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-12244ef6-ebe2-4104-b30d-281c52cfe528 req-77f5c74d-f267-4605-b16e-76602bd32778 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.370886 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-12244ef6-ebe2-4104-b30d-281c52cfe528 req-77f5c74d-f267-4605-b16e-76602bd32778 service nova] Creating event network-vif-deleted:67b64a6a-d7e2-4d07-8bc8-55d834fdb95c for instance 9b7f85e9-692b-454e-95f3-5dc087400373 on hv-cinder-81574 Aug 30 01:01:48.389928 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-12244ef6-ebe2-4104-b30d-281c52cfe528 req-77f5c74d-f267-4605-b16e-76602bd32778 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086187 Aug 30 01:01:48.401151 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 350/702] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:48.410327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:48.416788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:48.453835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.463335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.463335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.463335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.463335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.463659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.580374 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:48.589928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-beabc5de-c7b1-41be-8353-21dc1093d576 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1224 microversion: 2.1 time: 0.194137 Aug 30 01:01:48.591557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 353/703] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:48 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:48.631241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:48.634468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:48.647463 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.648158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.648762 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.649852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.652051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.653242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.723668 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-34cb0b5c-b69e-4c0f-af37-ea01e833734b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097185 Aug 30 01:01:48.737128 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 351/704] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:01:48 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:01:48.746198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:48.746860 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:48.751209 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:48.753211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:48.756329 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.756959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.757442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.758439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.759145 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.759801 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.768968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.769466 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.770201 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.771114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:48.771570 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:48.772041 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:48.834015 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-66ba5a7a-1d94-4294-80c5-60f0b387098d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/80817292-10c4-494b-bfed-cf0ca967bc2a" status: 200 len: 194 microversion: 2.1 time: 0.093172 Aug 30 01:01:48.834720 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 352/705] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 30 01:01:48 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/80817292-10c4-494b-bfed-cf0ca967bc2a => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:48.986863 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:48.996905 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:48.999197 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:49.000547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7374a054-72fe-48a9-bffa-c265d13fac04 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.264374 Aug 30 01:01:49.001630 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 354/706] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:48 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:49.217171 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:49.218625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:49.248946 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.250266 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.251503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.252517 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.253178 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.253803 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.509824 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:49.539052 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-64551c51-8abf-42e1-b8d5-9ff00c4ef6e9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.326563 Aug 30 01:01:49.539846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 353/707] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:49 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:49.616513 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:49.617142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:49.625738 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.626218 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.627885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.628762 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.629375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.632350 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.686730 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:49.687255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:49.687688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:49.688137 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lazy-loading 'fault' on Instance uuid 9b7f85e9-692b-454e-95f3-5dc087400373 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:01:49.741489 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:49.755969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-eb83a584-a7b8-4a66-864c-4dd98f35bd05 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 200 len: 1229 microversion: 2.1 time: 0.146656 Aug 30 01:01:49.770395 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 355/708] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:49 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 1229 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:50.026908 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:50.028234 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:50.040777 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.042559 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.042970 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.044123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.045042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.045653 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.256464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:50.269115 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:50.270581 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:50.272069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9143082f-f6de-4a39-a136-81f942bbd1bd tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.251426 Aug 30 01:01:50.272626 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 354/709] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:50 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:50.392150 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da297eb8-f9a4-4581-a905-802b8aa0159a"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:50.394572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:50.400801 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.401583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.402041 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.402854 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.403285 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.404240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.563289 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:50.563796 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:50.570410 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.571161 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.571755 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.572464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.572916 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.573336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.732425 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d25c746b-c326-4a37-acc4-0a9026a170c2 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "POST /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343357 Aug 30 01:01:50.742971 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 356/710] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:01:50 2022] POST /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:50.780048 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:50.781107 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:50.786507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:50.790410 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.791205 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.792275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.793432 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:50.794121 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:50.795673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:50.805616 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a157816f-8d1c-4656-9892-0677a721d705 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.246866 Aug 30 01:01:50.819409 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 355/711] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:50 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:50.832649 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] HTTP exception thrown: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Request method failure captured: Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 HTTP/1.1 Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWDBEN2kSBKcT1OLI8a2onvcxE4aLrugi-4jO7a-aHTBqhMKy3InvG2wLWGgNzRqyba05XI5s9JQTyu9Y41behMfj_X0JI7BfSR5hjFhC8ckXcSS4TqIE1LbszPE6gna_PSQ0EY8dJhFagoSoqpe7X0DMIPn-z3M2czJFi4bC7x-VTE Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:01:50.834554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4baca9d3a3e45d883482957e9ce8cb0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}] Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 455284c947254207a719459efc031bea Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:01:50.836157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '9b7f85e9-692b-454e-95f3-5dc087400373'} Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:01:50.836961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:01:50.838217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:01:50.840393 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Returning 404 to user: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:01:50.840393 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8ab95644-ca54-4c85-aeba-4a2d3b7c5021 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 404 len: 111 microversion: 2.1 time: 0.062666 Aug 30 01:01:50.847308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 357/712] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:50 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:01:50.958925 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-500688022", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-694307074", "security_groups": [{"name": "tempest-secgroup-smoke-1699795873"}], "block_device_mapping_v2": [{"uuid": "f25803fe-38bf-4bbd-a68c-d44c865dbc30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3714421d-bb5b-438f-b69d-78d97ba32811"}]}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:51.101975 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] validate_networks() for [('3714421d-bb5b-438f-b69d-78d97ba32811', None, None, None, None, None)] {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:01:51.295804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:51.297041 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:51.307803 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.308630 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.309584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.313777 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.314655 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.315104 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.603553 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:51.613382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:51.615132 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:51.616478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-61ed8ba7-c59a-43af-ad6a-963fd7d44add tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.325723 Aug 30 01:01:51.631487 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 358/713] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:51 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:01:51.778170 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:01:51.778655 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:01:51.780359 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:01:51.780938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:01:51.781351 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:01:51.791428 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.791907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.792331 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.793272 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.793722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.794139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.816524 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Getting quotas for project d4baca9d3a3e45d883482957e9ce8cb0. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:01:51.828455 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:51.829871 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:51.836331 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Getting quotas for user 455284c947254207a719459efc031bea and project d4baca9d3a3e45d883482957e9ce8cb0. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:01:51.840788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.842688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.844059 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.846361 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:51.847065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:51.849322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:51.926850 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:01:51.929376 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f25803fe-38bf-4bbd-a68c-d44c865dbc30',volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:01:52.040554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.049117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6cf48d74-1db7-419b-af8d-b97a83748c4b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.224611 Aug 30 01:01:52.063932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 359/714] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:51 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:52.161402 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b4176933-f93c-4ed7-8bfc-48dc6508c103 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.206432 Aug 30 01:01:52.162189 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 356/715] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:01:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:01:52.174091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-25223e56-eea5-4592-9855-63ef301cab8b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:52.174938 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-25223e56-eea5-4592-9855-63ef301cab8b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:52.259124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-25223e56-eea5-4592-9855-63ef301cab8b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.269784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-25223e56-eea5-4592-9855-63ef301cab8b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1093 microversion: 2.1 time: 0.100246 Aug 30 01:01:52.285536 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 360/716] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:52 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1093 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:52.643081 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:52.643695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:52.650318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:52.650579 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:52.651243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:52.652114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:52.652709 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:52.653279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:52.821851 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.836221 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.837882 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:52.839532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-88b77683-846e-4d40-a4a8-5bd19cc79d06 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.200241 Aug 30 01:01:52.840617 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 357/717] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:52 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:53.069780 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:53.070380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:53.079757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.080472 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.081075 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.081921 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.082512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.083109 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.101650 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:53.246424 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:53.257190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8e9fca19-7c10-4cd6-a3e4-4f118ea08d3c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.189031 Aug 30 01:01:53.257190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 361/718] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:53 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:53.293089 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:53.294803 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:53.303995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.304757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.305193 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.305897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.306507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.307132 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.382069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:53.390971 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d06be4e8-09e6-4d0a-b02a-293f914945b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1191 microversion: 2.1 time: 0.101969 Aug 30 01:01:53.391591 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 358/719] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:53 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1191 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:53.862950 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:53.863767 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:53.870875 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.871353 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.871969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:53.873044 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:53.873880 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:53.874312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.015325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:54.025626 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:54.027277 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:54.029059 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-99a1d2c1-8e52-4c38-ac0e-ec6a38b43c86 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.170010 Aug 30 01:01:54.043037 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 362/720] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:53 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:54.277198 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:54.277882 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:54.286600 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.287241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:54.288380 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.289318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.289831 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:54.290307 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.412869 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:54.414288 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:54.425879 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.426561 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:54.427214 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.428178 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:54.428812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:54.429376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:54.487203 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:54.497527 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c612deaa-c043-4b90-acd4-654dc1ac2ccc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.224253 Aug 30 01:01:54.502524 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 359/721] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:54 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:54.517771 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:54.526057 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f5e89915-7a43-4148-ad2b-1b5c1a1554ac tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1191 microversion: 2.1 time: 0.117938 Aug 30 01:01:54.526886 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 363/722] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:54 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1191 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:01:55.056328 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:55.057135 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:55.068789 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.069282 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.069713 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.074693 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.075243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.075744 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.354422 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:55.375418 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:55.378365 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:55.380503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7d386b16-82f0-48c6-beaf-d35fd8a446db tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.329441 Aug 30 01:01:55.382439 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 360/723] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:55 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:55.522385 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:55.522385 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:55.532166 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.532889 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.533312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.534012 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.534453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.534897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.548468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:55.551978 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:55.560142 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.560944 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.561745 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.563424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.564896 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.565479 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.672279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:55.680503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-57839e8c-d0c9-4642-a682-e7961f573ac3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1209 microversion: 2.1 time: 0.136416 Aug 30 01:01:55.685227 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 361/724] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:55 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1209 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:55.731357 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:55.739845 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2b42318f-6542-4bc3-9c7d-54be2653c363 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1570 microversion: 2.1 time: 0.224585 Aug 30 01:01:55.740948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 364/725] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:55 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1570 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:55.766285 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:55.767638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:55.775940 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.776653 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.777245 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.778182 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.778989 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.779685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.826169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=144776) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:01:55.917733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4dbdb118-3fd1-4e8f-86c4-55ace3a4fca3 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "POST /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1/action" status: 202 len: 0 microversion: 2.1 time: 0.156591 Aug 30 01:01:55.918979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 362/726] 10.222.0.17 () {60 vars in 1278 bytes} [Tue Aug 30 01:01:55 2022] POST /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:01:55.935678 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:55.938026 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:55.954065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.954572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.956871 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:55.959635 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:55.960113 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:55.960554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.193645 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:56.208093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9635e3d4-24b6-48ce-89ba-b4a15570d36b tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1578 microversion: 2.1 time: 0.283910 Aug 30 01:01:56.209160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 365/727] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:55 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1578 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:56.405534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:56.406441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:56.420871 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.421863 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.422584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.423527 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.424279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.424852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.610217 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:56.619736 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:56.621435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:56.622938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cdc15786-d08e-414a-86c9-a913285ba64c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.223719 Aug 30 01:01:56.624313 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 363/728] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:56 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:56.705309 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:56.706502 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:56.726149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.726149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.726149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.726149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:56.726625 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:56.726625 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:56.900806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:56.911119 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b297bf62-838e-4b4e-bdab-2397cef7213d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1277 microversion: 2.1 time: 0.210151 Aug 30 01:01:56.911937 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 366/729] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:56 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:57.230405 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:57.231603 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:57.238364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.241240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.241509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.242279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.242754 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.243212 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.247717 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:57.406792 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:57.415231 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a381249a-7eec-49e1-b80d-19b74525d753 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1578 microversion: 2.1 time: 0.189580 Aug 30 01:01:57.416951 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 364/730] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:57 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:57.645992 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:57.646586 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:57.654202 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.654969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.655559 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.656436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.657028 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.657628 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.801860 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:57.813977 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:57.815480 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:57.816755 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-32e01300-bb44-4a52-af28-d41c3598db64 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.174750 Aug 30 01:01:57.817336 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 367/731] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:57 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:01:57.932882 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:57.933948 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:57.940855 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.941341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.941768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:57.942487 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:57.942938 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:57.943430 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.115877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:58.164832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e78a5c18-3d71-4f41-b452-db79f7241b5d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1277 microversion: 2.1 time: 0.220772 Aug 30 01:01:58.164832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 365/732] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:57 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:58.439204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:58.440226 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:58.449378 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.451312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.452086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.453151 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.454181 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.454986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.624666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:58.636262 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a860e36d-7328-4f23-a6dc-02d2c58e8230 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1578 microversion: 2.1 time: 0.202852 Aug 30 01:01:58.650623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 368/733] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:58 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:58.779461 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-efcb6288-4f67-4b32-af0e-81e2b9d67785 req-83fef5c2-326b-4a8b-9c2e-e11cc9fa2ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ceda193-ffbd-453f-abf9-760cc5b4e6cd", "tag": "bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:01:58.785634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:01:58.792826 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-efcb6288-4f67-4b32-af0e-81e2b9d67785 req-83fef5c2-326b-4a8b-9c2e-e11cc9fa2ac1 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.794267 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-efcb6288-4f67-4b32-af0e-81e2b9d67785 req-83fef5c2-326b-4a8b-9c2e-e11cc9fa2ac1 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.794976 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-efcb6288-4f67-4b32-af0e-81e2b9d67785 req-83fef5c2-326b-4a8b-9c2e-e11cc9fa2ac1 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.814545 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-efcb6288-4f67-4b32-af0e-81e2b9d67785 req-83fef5c2-326b-4a8b-9c2e-e11cc9fa2ac1 service nova] Creating event network-changed:bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d for instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd on hv-cinder-81574 Aug 30 01:01:58.821658 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-efcb6288-4f67-4b32-af0e-81e2b9d67785 req-83fef5c2-326b-4a8b-9c2e-e11cc9fa2ac1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048577 Aug 30 01:01:58.822386 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 366/734] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:01:58.840033 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:58.840673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:58.847827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.848333 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.848742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:58.849444 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:58.849921 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:58.850454 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.012177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:59.021959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:59.023520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:59.024756 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-63d02a61-e5a3-442a-8944-6d625921faf1 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.188876 Aug 30 01:01:59.025339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 369/735] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:01:58 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:01:59.178723 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:59.179545 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:59.189040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.189538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.189968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.190633 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.191095 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.191544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.342314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:59.353767 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dda6212b-5e23-4a25-b117-73e494f1e554 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1277 microversion: 2.1 time: 0.182692 Aug 30 01:01:59.354421 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 367/736] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:59 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:01:59.662748 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:01:59.663811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:01:59.674386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.675228 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.676060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.677219 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:01:59.677954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:01:59.678653 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:01:59.823238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:01:59.831287 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-814d7644-4261-4b25-9d45-7f5c6941a3b0 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1578 microversion: 2.1 time: 0.175095 Aug 30 01:01:59.831853 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 370/737] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:01:59 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:00.049885 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:00.050472 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:00.060761 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.061720 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.062379 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.063448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.064141 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.064773 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.205766 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:00.218573 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:00.220809 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:00.222586 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-05a18bec-2872-4ab2-89dc-0f12e78cf9ee tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.178235 Aug 30 01:02:00.223384 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 368/738] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:00 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:00.375624 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:00.376231 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:00.382727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.383246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.383669 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.384383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.384824 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.385231 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.533206 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:00.545545 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-109272b7-9a9d-4fb0-8ea0-bc484111958f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1277 microversion: 2.1 time: 0.173366 Aug 30 01:02:00.546294 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 371/739] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:00 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:00.857318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:00.858109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:00.864764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.865238 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.865667 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:00.866347 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:00.866793 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:00.867249 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.037104 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:01.046122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fe3ee336-3ec3-4072-b247-a314ccb0a689 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1578 microversion: 2.1 time: 0.195360 Aug 30 01:02:01.046711 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 369/740] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:00 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1578 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:01.085245 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-7c4c7ff2-4360-4850-88af-cb18b04c5666 req-3bd9c2b1-9589-4735-afa8-30af46d0d863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f572fa1-3226-46e6-9899-4fcf86fd92f1", "name": "network-vif-unplugged", "status": "completed", "tag": "073c1fdc-8ca9-494e-8140-91ded92f4916"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:01.095852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-7c4c7ff2-4360-4850-88af-cb18b04c5666 req-3bd9c2b1-9589-4735-afa8-30af46d0d863 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.096350 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-7c4c7ff2-4360-4850-88af-cb18b04c5666 req-3bd9c2b1-9589-4735-afa8-30af46d0d863 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.096777 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-7c4c7ff2-4360-4850-88af-cb18b04c5666 req-3bd9c2b1-9589-4735-afa8-30af46d0d863 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.108131 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-7c4c7ff2-4360-4850-88af-cb18b04c5666 req-3bd9c2b1-9589-4735-afa8-30af46d0d863 service nova] Creating event network-vif-unplugged:073c1fdc-8ca9-494e-8140-91ded92f4916 for instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 on hv-cinder-81574 Aug 30 01:02:01.113113 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-7c4c7ff2-4360-4850-88af-cb18b04c5666 req-3bd9c2b1-9589-4735-afa8-30af46d0d863 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031703 Aug 30 01:02:01.113712 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 372/741] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:01.247874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:01.248603 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:01.254950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.255460 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.255887 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.256622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.257071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.257521 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.393314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:01.402113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:01.403610 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:01.404899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3ca08f17-4d15-40e1-8c03-1edefeb10711 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1740 microversion: 2.20 time: 0.162897 Aug 30 01:02:01.407621 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 370/742] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:01 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:01.567608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:01.568274 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:01.574668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.575172 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.575601 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.576805 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:01.577323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:01.577741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:01.798568 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:01.806692 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-529d0394-08b5-471e-abb4-180f2e42ee0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1277 microversion: 2.1 time: 0.244176 Aug 30 01:02:01.807399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 373/743] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:01 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:02.068848 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:02.069434 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:02.071816 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:02.072590 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:02.079869 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.080464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.080984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.081815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.082346 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.082841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.261976 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:02.275464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7a128954-cb35-411a-864e-23334ab73112 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1578 microversion: 2.1 time: 0.211268 Aug 30 01:02:02.276057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 371/744] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:02 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:02.431392 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:02.431998 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:02.434433 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:02.440879 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.441496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.441926 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.442610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.443084 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.443496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.681210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:02.705668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:02.707936 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:02.709973 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-98511d17-6ebd-447e-83ac-a5e315242e2e tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1722 microversion: 2.20 time: 0.282890 Aug 30 01:02:02.711771 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 374/745] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:02 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:02.828876 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:02.829486 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:02.837550 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.838346 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.838965 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.840012 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.840798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.841625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.867375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:02.870835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:02.877152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.877633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.878223 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.879487 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:02.880256 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:02.880938 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:02.915669 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e26d5d25-e70c-41e9-96d8-7e889ea76508 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052271 Aug 30 01:02:02.916557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 375/746] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:02:02 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:02.984870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:03.001507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3d4f7145-4fb2-48d7-b521-b4d65f9fd2a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.176427 Aug 30 01:02:03.015629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 372/747] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:02 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:03.061210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:03.061830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:03.069707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.070198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.070932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.071685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.072384 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.072850 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.104708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fa5ca663-0702-4cd7-9266-8fb0ad46a9e4 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/80817292-10c4-494b-bfed-cf0ca967bc2a" status: 200 len: 194 microversion: 2.1 time: 0.048339 Aug 30 01:02:03.105505 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 376/748] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 30 01:02:03 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/80817292-10c4-494b-bfed-cf0ca967bc2a => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:03.115904 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:03.116477 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:03.122906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.123224 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.123772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.124551 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.124983 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.125400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.218409 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'services' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:03.297369 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:03.298073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:03.300441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-752f11b1-3705-4b9f-92fc-12be0aad4d71 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/80817292-10c4-494b-bfed-cf0ca967bc2a" status: 202 len: 0 microversion: 2.1 time: 0.188219 Aug 30 01:02:03.304181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 373/749] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:02:03 2022] DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/80817292-10c4-494b-bfed-cf0ca967bc2a => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:02:03.305742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.306425 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.306975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.307716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.308151 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.308912 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.465833 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:03.482897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-80592ad2-9ae1-412e-91d2-4a562b35beb6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1520 microversion: 2.1 time: 0.188218 Aug 30 01:02:03.483762 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 377/750] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:03 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:03.734558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:03.735253 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:03.743708 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.744181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.744606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.745295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:03.745740 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:03.746151 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:03.918213 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:03.927729 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:03.929187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:03.930337 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-dda23f02-c91f-4c20-a493-9ca1170fc456 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1722 microversion: 2.20 time: 0.200430 Aug 30 01:02:03.930890 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 374/751] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:03 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:02:04.027872 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:04.028437 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:04.038694 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:04.039537 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:04.040258 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:04.041402 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:04.042154 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:04.042858 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:04.206605 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:04.208927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:04.216627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6cb48fa4-107c-4cbb-a80a-95cd10a7d8a4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.194512 Aug 30 01:02:04.217202 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 378/752] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:04 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:04.509850 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:04.510539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:04.536497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:04.537220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:04.537631 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:04.538390 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:04.538836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:04.539295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:04.693711 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:04.704584 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-13640d6c-9ee4-4f15-88c7-2351194bffdc tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1520 microversion: 2.1 time: 0.198818 Aug 30 01:02:04.705131 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 375/753] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:04 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:04.956335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:04.957047 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:04.963618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:04.964098 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:04.964526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:04.965209 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:04.965654 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:04.966054 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.128517 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:05.137038 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:05.138505 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:05.139779 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e9900b40-56dc-42d6-8c9e-81cc2942607a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1725 microversion: 2.20 time: 0.187472 Aug 30 01:02:05.140387 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 379/754] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:04 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:05.165142 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2371b55e-f8c2-4538-9e19-748b615e2a1d"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:05.169606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:05.179625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.180353 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.180783 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.181595 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.182075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.182598 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.242543 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:05.243204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:05.252293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.253383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.253999 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.254699 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.255364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.255788 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.406319 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:05.414916 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-bce8e77d-44c3-47ad-a144-c097928ec38e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.176187 Aug 30 01:02:05.415511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 380/755] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:05 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:05.506297 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a8d98d8a-6f62-4d8c-8648-dad7ff0ed6c0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346468 Aug 30 01:02:05.507346 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 376/756] 10.222.0.17 () {62 vars in 1364 bytes} [Tue Aug 30 01:02:05 2022] POST /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-volume_attachments => generated 188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 01:02:05.514216 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:05.515249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:05.522716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.523397 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.524040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.524732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.525545 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.525959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.574552 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6de7047c-e3b9-4594-b459-b4d5c96f0f06 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/da297eb8-f9a4-4581-a905-802b8aa0159a" status: 200 len: 194 microversion: 2.1 time: 0.064121 Aug 30 01:02:05.575185 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 381/757] 10.222.0.17 () {58 vars in 1413 bytes} [Tue Aug 30 01:02:05 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/da297eb8-f9a4-4581-a905-802b8aa0159a => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:02:05.592225 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:05.593769 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:05.677638 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:05.678493 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:05.686556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.687260 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.687723 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.688421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.688999 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.689428 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.771498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.771974 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.772402 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.773122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:05.773562 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:05.773980 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:05.865897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'services' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:05.871731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:06.019200 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d682f54c-24b3-47f8-a5ca-41ebc377521b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "DELETE /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-volume_attachments/2371b55e-f8c2-4538-9e19-748b615e2a1d" status: 202 len: 0 microversion: 2.20 time: 0.355145 Aug 30 01:02:06.019200 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 382/758] 10.222.0.17 () {60 vars in 1457 bytes} [Tue Aug 30 01:02:05 2022] DELETE /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-volume_attachments/2371b55e-f8c2-4538-9e19-748b615e2a1d => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:02:06.032091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:06.032725 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:06.045958 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.051764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.052955 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-2e3dc4ff-9e73-413e-a916-88fb1359a83b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/da297eb8-f9a4-4581-a905-802b8aa0159a" status: 202 len: 0 microversion: 2.1 time: 0.464792 Aug 30 01:02:06.053767 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.054029 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 377/759] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:02:05 2022] DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments/da297eb8-f9a4-4581-a905-802b8aa0159a => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:02:06.055561 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.056241 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.058681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.118261 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:06.121208 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:06.138203 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.148022 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.148531 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.149294 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.149756 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.150170 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.225663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=144776) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 01:02:06.315642 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:06.319100 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-498153f7-11c9-45cf-b47c-e73d5d60474c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "POST /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/action" status: 202 len: 0 microversion: 2.20 time: 0.207042 Aug 30 01:02:06.320056 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 378/760] 10.222.0.17 () {62 vars in 1319 bytes} [Tue Aug 30 01:02:06 2022] POST /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:02:06.324618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-d7c8adc2-172d-4867-a208-6ed257f89593 req-f4aa69bb-4e63-4989-8c5a-52211f0fe213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292814e8-5ed9-4973-beb5-106bb39d79d8", "name": "network-vif-unplugged", "status": "completed", "tag": "38122c0f-dd5b-474a-bd39-f20d490b5a6f"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:06.326757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c8c62eb2-8383-4128-a982-2269c080e322 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.308825 Aug 30 01:02:06.328108 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 383/761] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:06 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:06.333056 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:06.333914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:06.334830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d7c8adc2-172d-4867-a208-6ed257f89593 req-f4aa69bb-4e63-4989-8c5a-52211f0fe213 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.335335 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d7c8adc2-172d-4867-a208-6ed257f89593 req-f4aa69bb-4e63-4989-8c5a-52211f0fe213 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.335754 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d7c8adc2-172d-4867-a208-6ed257f89593 req-f4aa69bb-4e63-4989-8c5a-52211f0fe213 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.348059 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.compute.server_external_events [req-d7c8adc2-172d-4867-a208-6ed257f89593 req-f4aa69bb-4e63-4989-8c5a-52211f0fe213 service nova] Unable to find a host for instance 292814e8-5ed9-4973-beb5-106bb39d79d8. Dropping event network-vif-unplugged {{(pid=144776) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 01:02:06.348933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-d7c8adc2-172d-4867-a208-6ed257f89593 req-f4aa69bb-4e63-4989-8c5a-52211f0fe213 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027958 Aug 30 01:02:06.350263 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 379/762] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 01:02:06.351584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.351986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.352425 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.354297 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.354681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.355167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.438190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:06.438793 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:06.444893 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.445570 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.445991 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.446877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:06.447500 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:06.448248 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:06.529880 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:06.540586 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:06.542847 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:06.544584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ad9229a6-346c-4e4b-a96b-25746c05c58b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1673 microversion: 2.20 time: 0.215137 Aug 30 01:02:06.545149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 384/763] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:06 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1673 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:06.610928 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:06.619419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e6814ea6-ee9f-40fa-ad75-39c36f16d745 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.186186 Aug 30 01:02:06.634377 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 380/764] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:06 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:07.349379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.350521 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.363040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.365419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.368381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.370272 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.370929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.371775 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.372322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.373147 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.378646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.379727 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.380035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.380738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.381742 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.382340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.426482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f9195406-a9b8-4bbe-8b26-43628c754ea5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067266 Aug 30 01:02:07.428137 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 381/765] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:02:07 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:02:07.572649 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.573246 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.579518 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.579995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.580424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.581304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.581912 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.582486 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.585714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:07.594661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9ea5e866-7ce0-43a1-8d2f-4c0832dca3b1 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.249471 Aug 30 01:02:07.595433 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 385/766] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:07 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:07.601675 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.604228 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.610676 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.611274 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.611742 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.612440 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.612896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.613332 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.647308 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ed3bad23-85b0-44fe-bb2c-470934487f8a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050590 Aug 30 01:02:07.647936 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 386/767] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:02:07 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:02:07.652314 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.659339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.669088 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.669673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.670159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.670927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.671460 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.671954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.759543 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:07.768988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:07.770429 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:07.771600 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4740ff17-523f-4923-94ed-f089038f7ef7 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1675 microversion: 2.20 time: 0.203198 Aug 30 01:02:07.772158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 382/768] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:07 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:02:07.776528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.777006 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.783476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.783974 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.784382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.785064 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.785505 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.785919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.814762 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:02:07.831956 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:07.839809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8590e7fb-ae14-4366-80c4-b1b759268982 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.190961 Aug 30 01:02:07.840383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 387/769] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:07 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:07.900451 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5dcc8b50-1ff1-4741-b388-8341b4671297 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 204 len: 0 microversion: 2.1 time: 0.127098 Aug 30 01:02:07.901007 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 383/770] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:02:07 2022] DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:02:07.909360 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:07.909967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:07.916382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.916858 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.917287 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:07.917975 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:07.918422 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:07.918823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.060770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:08.069194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3613dfcc-b37c-40a4-9381-1c009b008096 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1672 microversion: 2.1 time: 0.163713 Aug 30 01:02:08.069761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 388/771] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:07 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:08.617209 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:08.617895 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:08.624921 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.625378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.625799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.626601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.627074 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.627496 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.776816 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:08.785223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4079e511-62e2-417e-956f-5a66faa02c82 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.172301 Aug 30 01:02:08.785789 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 384/772] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:08 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:08.794964 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:08.795633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:08.802629 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.803161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.803590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.804269 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.804697 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.805120 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.860644 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:08.861280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:08.867771 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.868253 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.868680 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.869372 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:08.869821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:08.870275 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:08.990064 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:08.998923 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:09.000488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:09.001654 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c859fe70-48dd-48f4-bfec-cc19f69703e9 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.210716 Aug 30 01:02:09.002249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 389/773] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:08 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:09.037859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:09.045833 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4376d5a3-8615-412c-860d-c2d79f608795 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.188939 Aug 30 01:02:09.046410 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 385/774] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:08 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:09.099193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:09.099790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:09.106389 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:09.106861 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:09.107514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:09.108257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:09.108704 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:09.109118 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:09.264848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:09.273384 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9950161b-3b16-4850-96e8-1957b2bb556b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1672 microversion: 2.1 time: 0.178188 Aug 30 01:02:09.273940 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 390/775] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:09 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:09.806603 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:09.807182 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:09.814259 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:09.814729 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:09.815187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:09.815880 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:09.816324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:09.816744 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:09.958530 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:09.966696 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8bb92676-9ff9-4812-bf4a-84aeefaf42bb tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.164080 Aug 30 01:02:09.967318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 386/776] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:09 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:10.024935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:10.025609 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:10.033252 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.033722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.034139 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.034822 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.035311 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.035727 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.074040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:10.074627 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:10.081628 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.082118 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.082551 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.083292 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.083744 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.084163 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.227868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:10.237178 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:10.238735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:10.239919 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-35bcc3c8-6d0f-45b1-af0b-9b435cd3675d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.219192 Aug 30 01:02:10.240510 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 391/777] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:10 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:10.259763 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:10.267810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d014ba68-4c28-4a59-a7ae-36809bde66f2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.197902 Aug 30 01:02:10.268379 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 387/778] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:10 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:10.305629 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:10.306426 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:10.314452 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.314925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.315375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.316054 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.316499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:10.316914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:10.464234 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:10.467840 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:10.473506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a1bd79c7-39bc-461e-85e8-98822dd45ea3 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1672 microversion: 2.1 time: 0.174139 Aug 30 01:02:10.474167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 392/779] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:10 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:10.989781 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:10.990406 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:10.997349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:10.997876 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.001601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.002445 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.002917 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.003370 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.150393 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:11.159470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-78467bad-cecf-49b6-8fab-2784836e40b9 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.173689 Aug 30 01:02:11.160044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 388/780] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:10 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:11.267069 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:11.267668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:11.275186 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.275759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.276181 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.276868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.277307 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.277721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.288344 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:11.288981 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:11.295154 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.295641 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.296328 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.297037 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.297487 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.297906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.475554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:11.479953 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:11.484397 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:11.485910 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:11.487177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-51da7481-17cb-4747-abb5-41addfe4c180 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.226619 Aug 30 01:02:11.487827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 393/781] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:11 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:11.492386 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1d8e366c-a64b-4fd5-a2c4-dd03b6176667 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.207881 Aug 30 01:02:11.492957 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 389/782] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:11 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:11.495208 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:11.495910 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:11.502350 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.502941 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.503511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.504195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:11.504645 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:11.505056 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:11.662095 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:11.669976 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-52ca10bf-9c21-4183-a18d-22567d12fa7a tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1672 microversion: 2.1 time: 0.178705 Aug 30 01:02:11.670516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 394/783] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:11 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:12.184091 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:12.184712 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:12.191733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.192211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.192636 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.193395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.193838 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.194254 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.399307 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:12.407560 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-30bf9c32-e351-421d-8604-351ff3f4abb2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.227938 Aug 30 01:02:12.408121 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 390/784] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:12 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:12.511546 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:12.512286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:12.512945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:12.513592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:12.519974 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.520251 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.520497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.520779 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.520947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.521159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.521656 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.521799 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.522099 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.522263 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.522506 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.522673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.727022 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:12.729561 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:12.737847 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f27bf749-ef69-47ef-a147-0fdbddf43df1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.228789 Aug 30 01:02:12.750893 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 391/785] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:12 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:12.751160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:12.751160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:12.751160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c1116a69-cdbe-49c6-a73d-bdbea502833a tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.235450 Aug 30 01:02:12.752830 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 395/786] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:12 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:12.756618 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:12.757783 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:12.764053 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.764802 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.765043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.765773 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:12.766219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:12.766635 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:12.770861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:12.904389 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:12.916499 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8c4a1719-bf80-4efc-9831-1c2f5832e12d tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1672 microversion: 2.1 time: 0.176250 Aug 30 01:02:12.917256 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 392/787] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:12 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:13.432709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:13.433673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:13.440371 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.441290 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.441722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.442423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.442869 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.443313 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.757955 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:13.758532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:13.765382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.766272 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.766883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.767797 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.768404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.769166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.820397 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:13.829896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-bed1a5d5-d093-4df1-9089-742728112200 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.401032 Aug 30 01:02:13.831288 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 396/788] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:13 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:13.847807 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:13.848677 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:13.855381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.856266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.856803 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:13.857634 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:13.858191 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:13.859065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.380207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:14.391183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c560ef4b-2ec0-42ee-8a15-e061032421ee tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.636935 Aug 30 01:02:14.404855 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 393/789] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:13 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:14.408407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:14.411404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:14.412176 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:14.421319 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.422364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.422964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.424277 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.424590 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:14.425079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.425666 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.428134 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:14.430831 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7e776157-c753-4fd9-8cec-5a48558d3ce0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.598282 Aug 30 01:02:14.437412 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 397/790] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:13 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:14.493096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:14.501467 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-81373cc8-5ffb-4607-a8ee-6fb84a43fa9f tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1604 microversion: 2.1 time: 0.093973 Aug 30 01:02:14.503408 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 394/791] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:14 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1604 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:14.644187 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-eba930f4-499d-4a99-92d6-5c236718770d req-a65ec5cd-a3eb-4f72-8ec4-a57d2f6ed11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4af42e2-b719-447c-9ca5-5d9c7318ae25", "name": "network-vif-deleted", "tag": "790719ad-0265-4bf6-b00c-4368bb0a354e"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:14.663758 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-eba930f4-499d-4a99-92d6-5c236718770d req-a65ec5cd-a3eb-4f72-8ec4-a57d2f6ed11b service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.664747 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-eba930f4-499d-4a99-92d6-5c236718770d req-a65ec5cd-a3eb-4f72-8ec4-a57d2f6ed11b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.665860 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-eba930f4-499d-4a99-92d6-5c236718770d req-a65ec5cd-a3eb-4f72-8ec4-a57d2f6ed11b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.685319 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-eba930f4-499d-4a99-92d6-5c236718770d req-a65ec5cd-a3eb-4f72-8ec4-a57d2f6ed11b service nova] Creating event network-vif-deleted:790719ad-0265-4bf6-b00c-4368bb0a354e for instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 on hv-cinder-81574 Aug 30 01:02:14.693303 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-eba930f4-499d-4a99-92d6-5c236718770d req-a65ec5cd-a3eb-4f72-8ec4-a57d2f6ed11b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055027 Aug 30 01:02:14.694843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 398/792] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:14.853510 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:14.854589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:14.865121 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.866508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.867355 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:14.869807 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:14.871139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:14.872863 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.195781 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:15.207749 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d30ba3e1-ac46-422e-aac9-8f6d9d36ba74 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.358091 Aug 30 01:02:15.208868 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 395/793] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:14 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:15.414654 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:15.416370 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:15.419561 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:15.437040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.438635 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.439141 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.440204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.440591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.441008 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.461989 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:15.462993 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:15.482247 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.483504 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.486452 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.489216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.490645 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.492721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.827439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:15.840160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-de8c9987-3058-479a-881e-d9419024a0b8 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.430304 Aug 30 01:02:15.842130 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 399/794] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:15 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:15.860635 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:15.861423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:15.875041 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.875986 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.876588 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.877766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.880918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.881778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.923722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:15.924681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:15.926417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:15.927137 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:15.931443 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:15.942621 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:15.953214 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:15.954690 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-13abf997-0744-4ff3-aabe-e11730effc4c tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.497914 Aug 30 01:02:15.955878 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 396/795] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:15 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:02:15.984638 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:15.996316 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-dbc9f502-3241-4c2c-826b-9fe23e4524c5 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1328 microversion: 2.1 time: 0.151816 Aug 30 01:02:16.012509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 400/796] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:15 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1328 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:16.231196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:16.231949 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:16.243265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.244696 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.245419 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:16.246532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.247341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.248038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:16.548055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:16.557302 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-67961eff-ac54-42e7-953d-3e8a53f9cfc8 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.330787 Aug 30 01:02:16.581976 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 397/797] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:16 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:16.866651 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:16.867888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:16.875071 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.875898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.876773 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:16.877798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.878553 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.879207 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:16.981732 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:16.982311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:16.994295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:16.997139 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:16.998162 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.002146 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:17.003040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:17.003673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.125078 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.134733 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f4221d87-e668-450f-8c34-33ae9974b419 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.272427 Aug 30 01:02:17.135349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 401/798] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:16 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:17.153667 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:17.154306 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:17.164916 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:17.165401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:17.178852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.179766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:17.180241 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:17.180672 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.227575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:17.228057 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:17.228541 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.229159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:17.276411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.284974 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-320ae256-891e-400c-a820-f4bcc7c2b027 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1328 microversion: 2.1 time: 0.148501 Aug 30 01:02:17.285584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 402/799] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:17 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1328 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:17.324279 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.336235 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.338149 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.340002 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6ec0246a-f35e-4787-9c88-b3ea122765e5 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.362290 Aug 30 01:02:17.342721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 398/800] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:16 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 01:02:17.584510 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:17.585100 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:17.591449 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:17.591919 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:17.592343 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.593283 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:17.593875 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:17.594293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:17.773764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:17.786328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-00e3e6ea-d289-4b8e-81d6-8ba46c9ff828 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.205536 Aug 30 01:02:17.795963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 403/801] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:17 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:18.157018 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:18.158560 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:18.166910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.167468 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.167888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.168629 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.169114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.169591 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.321999 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:18.322553 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:18.329997 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.330724 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.331425 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.332404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.333060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.333693 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.402364 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.415126 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.416135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.417688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:18.528162 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:18.539888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1144c7af-6669-40b3-9437-48cd6df3b9ca tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1328 microversion: 2.1 time: 0.228952 Aug 30 01:02:18.540481 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 404/802] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:18 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1328 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:18.556910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:18.561721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:18.562716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:18.571817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ffe053d9-a35f-476c-9c64-4f51703f8597 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.418582 Aug 30 01:02:18.572805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 399/803] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:18 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:18.579968 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.580462 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.580892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.581604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.582055 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.582476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.590521 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-6942ea09-d58d-46f8-861f-39f8baa51fdc req-5f4e0025-3e13-4722-b7d8-7e2d6389164a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceda193-ffbd-453f-abf9-760cc5b4e6cd", "name": "network-vif-plugged", "status": "completed", "tag": "bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:18.615756 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-6942ea09-d58d-46f8-861f-39f8baa51fdc req-5f4e0025-3e13-4722-b7d8-7e2d6389164a service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.616843 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-6942ea09-d58d-46f8-861f-39f8baa51fdc req-5f4e0025-3e13-4722-b7d8-7e2d6389164a service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.618619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-6942ea09-d58d-46f8-861f-39f8baa51fdc req-5f4e0025-3e13-4722-b7d8-7e2d6389164a service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.646733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-6942ea09-d58d-46f8-861f-39f8baa51fdc req-5f4e0025-3e13-4722-b7d8-7e2d6389164a service nova] Creating event network-vif-plugged:bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d for instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd on hv-cinder-81574 Aug 30 01:02:18.654148 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-6942ea09-d58d-46f8-861f-39f8baa51fdc req-5f4e0025-3e13-4722-b7d8-7e2d6389164a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075005 Aug 30 01:02:18.655664 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 400/804] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:18.812740 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:18.813550 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:18.823891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.823891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.823891 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.824609 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:18.829821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:18.830442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:18.864363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:18.877260 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:18.879255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:18.882251 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-935309a7-54d6-4438-b830-014380efbc9b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.340075 Aug 30 01:02:18.883513 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 405/805] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:18 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:19.039054 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:19.048612 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3dd610af-a24b-44f5-9fa0-c415e0e72699 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.242358 Aug 30 01:02:19.049821 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 401/806] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:18 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:19.563662 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:19.564305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:19.570897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.571416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.571856 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.572554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.573000 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.573413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.594611 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:19.595341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:19.602476 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.602956 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.603413 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.604112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.604562 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.604978 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.609295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.610073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.610503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.610944 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:19.677928 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:19.688768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-910cc054-cf1a-447c-aa2a-42ce0bf99821 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1328 microversion: 2.1 time: 0.128901 Aug 30 01:02:19.689623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 406/807] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:19 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:19.776529 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:19.785309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-690c2526-e6e1-4456-af25-07d305cb19f3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.195103 Aug 30 01:02:19.786133 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 402/808] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:19 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:19.911457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:19.912820 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:19.926450 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.927583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.928567 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:19.930064 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:19.931168 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:19.932300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.072663 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:20.073321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:20.081107 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.081665 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.082146 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.083372 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.084028 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.084718 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.249146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:20.270113 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:20.272062 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:20.279385 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-92bc971a-47fb-430f-8f75-bc8e6b4398eb tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.374612 Aug 30 01:02:20.295681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 407/809] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:19 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:20.334432 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:20.342425 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-29adb793-ae44-431e-9a97-ac04f104887c tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.274133 Aug 30 01:02:20.343065 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 403/810] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:20 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:20.710580 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:20.712018 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:20.719087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.719649 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.720104 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.721081 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.721525 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.721949 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.754980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.755797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.756220 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.756640 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:20.759811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:20.802327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:20.811416 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:20.812073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f9e37bc0-4171-4d94-9df9-f4798f4d6853 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1328 microversion: 2.1 time: 0.104549 Aug 30 01:02:20.812471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 408/811] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:20 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1328 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:20.813187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:20.820147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.821016 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.821658 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.822568 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.823263 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.823889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.826887 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-ada389ad-93e7-4ee1-b44d-0d6cdf1d92be req-f1caeb8b-3a79-48c2-869d-6f9ecf5fc625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f572fa1-3226-46e6-9899-4fcf86fd92f1", "name": "network-vif-plugged", "status": "completed", "tag": "073c1fdc-8ca9-494e-8140-91ded92f4916"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:20.837233 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-ada389ad-93e7-4ee1-b44d-0d6cdf1d92be req-f1caeb8b-3a79-48c2-869d-6f9ecf5fc625 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:20.837707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-ada389ad-93e7-4ee1-b44d-0d6cdf1d92be req-f1caeb8b-3a79-48c2-869d-6f9ecf5fc625 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:20.838133 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-ada389ad-93e7-4ee1-b44d-0d6cdf1d92be req-f1caeb8b-3a79-48c2-869d-6f9ecf5fc625 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:20.853752 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-ada389ad-93e7-4ee1-b44d-0d6cdf1d92be req-f1caeb8b-3a79-48c2-869d-6f9ecf5fc625 service nova] Creating event network-vif-plugged:073c1fdc-8ca9-494e-8140-91ded92f4916 for instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 on hv-cinder-81574 Aug 30 01:02:20.859536 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-ada389ad-93e7-4ee1-b44d-0d6cdf1d92be req-f1caeb8b-3a79-48c2-869d-6f9ecf5fc625 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045642 Aug 30 01:02:20.860661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 409/812] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:20.981553 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:20.991590 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-df5ef37d-ca9d-42c5-925f-73c36d62fb4c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.189671 Aug 30 01:02:20.992360 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 404/813] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:20 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:21.305498 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:21.306349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:21.314403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.315044 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.315791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.316573 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.317079 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.317664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.364228 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:21.365096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:21.374462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.381009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.381009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.381009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.381009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.381483 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.577832 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:21.591420 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:21.594682 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:21.597425 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-acea91a7-8e1a-450b-b5d2-c8373c18dbea tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.296778 Aug 30 01:02:21.613464 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 410/814] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:21 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:21.694381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:21.704122 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d157c422-2eb1-43f8-af16-64b565c22ea7 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.342738 Aug 30 01:02:21.705311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 405/815] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:21 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:21.832829 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:21.833463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:21.842476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.843653 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.843653 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.844491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.844941 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.845480 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.883223 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:21.883789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:21.884275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:21.884759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:21.934846 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:21.943803 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-adddfb9c-8e9d-4b13-ad37-98514b035fab tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1328 microversion: 2.1 time: 0.114979 Aug 30 01:02:21.944692 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 411/816] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:21 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:22.012910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:22.013735 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:22.021359 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.021964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.022439 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.023205 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.024212 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.024637 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.170030 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:22.179288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d4f5b792-9f49-4c13-b12e-8cc4eff17ba6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.170264 Aug 30 01:02:22.194272 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 406/817] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:22 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:22.626271 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:22.626982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:22.634894 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.635503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.636042 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.636835 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.637401 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.637939 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.729737 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:22.731261 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:22.738934 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.739634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.740073 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.740777 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.741228 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.741651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.801386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:22.810891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:22.818542 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:22.820854 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-12c02d49-d6f3-4417-bcca-0698fe8f5155 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.199872 Aug 30 01:02:22.821945 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 412/818] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:22 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:22.899438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:22.908020 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-47dbf71f-307f-4d41-8caf-d4da8cca9fd2 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.182208 Aug 30 01:02:22.908681 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 407/819] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:22 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:02:22.965731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:22.966340 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:22.973395 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.974104 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.974485 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:22.975293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:22.975845 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:22.976269 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.008213 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.008688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.009120 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.009571 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:23.054336 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:23.062721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0d725926-4568-400a-b9e5-3963d55ffac0 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1328 microversion: 2.1 time: 0.100866 Aug 30 01:02:23.063386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 413/820] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:22 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:23.202211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:23.202840 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:23.210230 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.210730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.211165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.211968 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.212268 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.212725 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.363396 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:23.371300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0c75f30b-6414-4058-8109-6b2159ec406e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.173429 Aug 30 01:02:23.371917 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 408/821] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:23 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:23.845778 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:23.846378 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:23.852901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.853379 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.853807 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.854495 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.854946 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.855393 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.930059 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:23.930802 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:23.937757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.938236 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.938639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.939387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:23.939841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:23.940263 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:23.959487 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=100 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:24.031324 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:24.040295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:24.041761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:24.042937 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-514cb1ae-c5c8-4110-b726-ff1f8ab1aa39 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.201788 Aug 30 01:02:24.043550 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 414/822] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:23 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:24.084756 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:24.085426 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:24.091992 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.092598 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.093895 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.094481 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.095142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.095759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.097544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:24.106808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-384c7c8e-5608-4f3a-aa8a-e5360b962902 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.180698 Aug 30 01:02:24.108762 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 409/823] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:23 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:24.133399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.133913 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.134306 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.134775 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lazy-loading 'fault' on Instance uuid d4af42e2-b719-447c-9ca5-5d9c7318ae25 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:02:24.192447 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22f11e29c4ad4712a54877b0895d28a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e919c196d074b8989b4719267ce24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:24.200610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5138b7df-6844-483d-9f0b-1089f816a61b tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 200 len: 1328 microversion: 2.1 time: 0.120026 Aug 30 01:02:24.201176 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 415/824] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:24 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:24.396722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:24.397324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:24.405170 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:24.417799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.418323 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.418806 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.419610 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:24.420067 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:24.420497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:24.567868 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:24.575812 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-712990e5-56f6-461c-9b47-ba57abc99705 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1265 microversion: 2.1 time: 0.187194 Aug 30 01:02:24.576390 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 410/825] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:24 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:25.071554 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.072157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.081511 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.081988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.082407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.083161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.083591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.084010 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.129601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.130224 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.136695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.137153 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.137598 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.138286 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.138730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.139173 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.277063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:25.286014 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:25.287466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:25.288625 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-414c543d-7f60-4ef9-9dff-964c88970dac tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.223496 Aug 30 01:02:25.289183 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 416/826] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:25 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:25.293510 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.294064 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.300266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.300665 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.301099 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.301766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.302182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.302619 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.307260 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:25.316356 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-08b335ba-7af8-405d-aea2-f864b808d437 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1576 microversion: 2.1 time: 0.191061 Aug 30 01:02:25.316970 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 411/827] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:25 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:25.317708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] HTTP exception thrown: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Request method failure captured: Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 HTTP/1.1 Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAcUi_xogd_SxYF57wsmObM4wNkbRO_I6acBFO5oLmcUSX_h7wdj7XtkUFkTUCs24k6HORWaqzoN5NmcH6f_h1vkHyAu0ULxqOcKAki1KmG3e8PtN6NuXhFL-B5v_Huj18UKH4Gi0DMrxl2eNdya_Ef3FVm9Rwobz2rlMY7PodXxro Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:02:25.319491 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e919c196d074b8989b4719267ce24f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}] Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 22f11e29c4ad4712a54877b0895d28a4 Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:25.321034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': 'd4af42e2-b719-447c-9ca5-5d9c7318ae25'} Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:25.322148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:25.323479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:25.325741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Returning 404 to user: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:25.325741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-75bdf31b-a7cd-44e3-a932-3c54eda8665e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 404 len: 111 microversion: 2.1 time: 0.030773 Aug 30 01:02:25.325741 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 417/828] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:25 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:25.330110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-100e5f09-c5bd-4ca0-bf93-0ba44881eea6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '.version_select at 0x7f03a1e520d0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.351671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-100e5f09-c5bd-4ca0-bf93-0ba44881eea6 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966803583" status: 202 len: 0 microversion: 2.1 time: 0.025447 Aug 30 01:02:25.352388 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 412/829] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 30 01:02:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966803583 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:02:25.597821 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.598437 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.605121 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.605610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.606040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.606994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.607475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.607897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.840496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:25.853298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-51a00e9a-ef81-4d90-9fce-3032d5f648d4 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1453 microversion: 2.1 time: 0.259981 Aug 30 01:02:25.855051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 418/830] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:25 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1453 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:25.875520 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:25.876750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:25.886841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.887704 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.888129 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:25.888815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:25.889406 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:25.889828 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.120155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:26.129844 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a53bca09-75ef-4641-9600-0149ed6875c6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1453 microversion: 2.1 time: 0.259529 Aug 30 01:02:26.130872 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 413/831] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:25 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1453 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:26.313752 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:26.315476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:26.320400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-e7eb95f9-bfba-4f19-94ce-b2e17042a2a3 req-b3449b4a-4a69-45d5-9234-6ead85f4af91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292814e8-5ed9-4973-beb5-106bb39d79d8", "name": "network-vif-plugged", "status": "completed", "tag": "38122c0f-dd5b-474a-bd39-f20d490b5a6f"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:26.325610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:26.326417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:26.327552 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.328754 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:26.329972 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:26.330618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.339198 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e7eb95f9-bfba-4f19-94ce-b2e17042a2a3 req-b3449b4a-4a69-45d5-9234-6ead85f4af91 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:26.339786 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e7eb95f9-bfba-4f19-94ce-b2e17042a2a3 req-b3449b4a-4a69-45d5-9234-6ead85f4af91 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:26.340228 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e7eb95f9-bfba-4f19-94ce-b2e17042a2a3 req-b3449b4a-4a69-45d5-9234-6ead85f4af91 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.352832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-e7eb95f9-bfba-4f19-94ce-b2e17042a2a3 req-b3449b4a-4a69-45d5-9234-6ead85f4af91 service nova] Creating event network-vif-plugged:38122c0f-dd5b-474a-bd39-f20d490b5a6f for instance 292814e8-5ed9-4973-beb5-106bb39d79d8 on hv-cinder-81574 Aug 30 01:02:26.367853 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-e7eb95f9-bfba-4f19-94ce-b2e17042a2a3 req-b3449b4a-4a69-45d5-9234-6ead85f4af91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051643 Aug 30 01:02:26.368454 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 414/832] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:02:26.373704 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:26.374682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:26.381993 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:26.382799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:26.383462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.384412 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:26.385050 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:26.385969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:26.621347 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:26.626594 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:26.631032 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:26.632456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:26.633814 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-90dfa05f-6729-419b-a500-035894f33d5f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.326582 Aug 30 01:02:26.634377 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 419/833] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:26 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:26.642185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cd3d3ce3-3f50-47c9-944b-c683369cf5a6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1563 microversion: 2.1 time: 0.272334 Aug 30 01:02:26.642993 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 415/834] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:26 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1563 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:27.657966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:27.658585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:27.667700 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:27.668738 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:27.669148 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:27.669837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:27.670266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:27.670682 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:27.817881 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:27.828359 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:27.830043 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:27.831566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-3334f36d-c34c-4eda-bdb4-15dc53f31c41 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1731 microversion: 2.20 time: 0.178231 Aug 30 01:02:27.843065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 420/835] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:27 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:28.024244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-94e810b3-2fb6-4d63-82ce-0a5e2deaf1a4 req-a15801a3-1dff-434a-899d-9360489d27c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ceda193-ffbd-453f-abf9-760cc5b4e6cd", "tag": "bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:28.034983 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-94e810b3-2fb6-4d63-82ce-0a5e2deaf1a4 req-a15801a3-1dff-434a-899d-9360489d27c1 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.035484 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-94e810b3-2fb6-4d63-82ce-0a5e2deaf1a4 req-a15801a3-1dff-434a-899d-9360489d27c1 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.035906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-94e810b3-2fb6-4d63-82ce-0a5e2deaf1a4 req-a15801a3-1dff-434a-899d-9360489d27c1 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:28.047749 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-94e810b3-2fb6-4d63-82ce-0a5e2deaf1a4 req-a15801a3-1dff-434a-899d-9360489d27c1 service nova] Creating event network-changed:bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d for instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd on hv-cinder-81574 Aug 30 01:02:28.052159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-94e810b3-2fb6-4d63-82ce-0a5e2deaf1a4 req-a15801a3-1dff-434a-899d-9360489d27c1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032640 Aug 30 01:02:28.052738 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 416/836] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:28.572325 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:28.573087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:28.591365 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.591365 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.591365 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:28.591365 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.591732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.591732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:28.603605 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] HTTP exception thrown: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Request method failure captured: Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 HTTP/1.1 Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAcUi_xogd_SxYF57wsmObM4wNkbRO_I6acBFO5oLmcUSX_h7wdj7XtkUFkTUCs24k6HORWaqzoN5NmcH6f_h1vkHyAu0ULxqOcKAki1KmG3e8PtN6NuXhFL-B5v_Huj18UKH4Gi0DMrxl2eNdya_Ef3FVm9Rwobz2rlMY7PodXxro Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:02:28.605281 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e919c196d074b8989b4719267ce24f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}] Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 22f11e29c4ad4712a54877b0895d28a4 Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.606852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': 'd4af42e2-b719-447c-9ca5-5d9c7318ae25'} Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:28.607770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.609278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.610719 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Returning 404 to user: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:28.610719 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-00bd1811-7673-49f5-b62a-f4d1e94c021e tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 404 len: 111 microversion: 2.1 time: 0.040217 Aug 30 01:02:28.617324 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 421/837] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:02:28 2022] DELETE /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:28.621753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:28.622678 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: d4af42e2-b719-447c-9ca5-5d9c7318ae25] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:28.629453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.630010 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.630507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:28.631298 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.631840 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.632319 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:28.647844 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] HTTP exception thrown: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Request method failure captured: Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 HTTP/1.1 Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAcUi_xogd_SxYF57wsmObM4wNkbRO_I6acBFO5oLmcUSX_h7wdj7XtkUFkTUCs24k6HORWaqzoN5NmcH6f_h1vkHyAu0ULxqOcKAki1KmG3e8PtN6NuXhFL-B5v_Huj18UKH4Gi0DMrxl2eNdya_Ef3FVm9Rwobz2rlMY7PodXxro Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:02:28.649606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e919c196d074b8989b4719267ce24f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}] Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 22f11e29c4ad4712a54877b0895d28a4 Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.651207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'd4af42e2-b719-447c-9ca5-5d9c7318ae25'} Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:28.652096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. Aug 30 01:02:28.653525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:28.654883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Returning 404 to user: Instance d4af42e2-b719-447c-9ca5-5d9c7318ae25 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:28.654883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d54e97b3-bf0d-4166-a39a-e1ece61427d9 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25" status: 404 len: 111 microversion: 2.1 time: 0.038504 Aug 30 01:02:28.654883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 417/838] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:28 2022] GET /compute/v2.1/servers/d4af42e2-b719-447c-9ca5-5d9c7318ae25 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:02:28.856878 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:28.857525 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:28.866674 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.867290 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.867751 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:28.868686 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:28.869292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:28.869952 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:29.062144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:29.071572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:29.072984 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:29.074497 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9b2a9d8c-a2e9-43cd-84ac-372a9ce94c0b tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1718 microversion: 2.20 time: 0.221771 Aug 30 01:02:29.075064 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 422/839] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:02:28 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1718 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:02:29.858360 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:29.858929 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:29.866063 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:29.866543 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:29.866972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:29.867695 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:29.868143 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:29.868561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:29.882749 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] HTTP exception thrown: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Request method failure captured: Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: DELETE /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 HTTP/1.1 Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWAcUi_xogd_SxYF57wsmObM4wNkbRO_I6acBFO5oLmcUSX_h7wdj7XtkUFkTUCs24k6HORWaqzoN5NmcH6f_h1vkHyAu0ULxqOcKAki1KmG3e8PtN6NuXhFL-B5v_Huj18UKH4Gi0DMrxl2eNdya_Ef3FVm9Rwobz2rlMY7PodXxro Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:02:29.884329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e919c196d074b8989b4719267ce24f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}] Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 22f11e29c4ad4712a54877b0895d28a4 Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.885832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '7d7655de-fe79-4bbd-abb5-5908ef3acda9'} Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:29.886634 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.887875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.889080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Returning 404 to user: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:29.889080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8856b792-07e3-4cf3-8aa0-b01b22876998 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 404 len: 111 microversion: 2.1 time: 0.031684 Aug 30 01:02:29.889080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 418/840] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:02:29 2022] DELETE /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:29.894693 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:29.895289 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] [instance: 7d7655de-fe79-4bbd-abb5-5908ef3acda9] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:29.902280 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:29.902759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:29.903238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:29.903935 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:29.904446 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:29.904870 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:29.918338 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] HTTP exception thrown: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Request method failure captured: Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 HTTP/1.1 Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWAcUi_xogd_SxYF57wsmObM4wNkbRO_I6acBFO5oLmcUSX_h7wdj7XtkUFkTUCs24k6HORWaqzoN5NmcH6f_h1vkHyAu0ULxqOcKAki1KmG3e8PtN6NuXhFL-B5v_Huj18UKH4Gi0DMrxl2eNdya_Ef3FVm9Rwobz2rlMY7PodXxro Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:02:29.919885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e919c196d074b8989b4719267ce24f8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e919c196d074b8989b4719267ce24f8"}]}] Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 7e919c196d074b8989b4719267ce24f8 Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1475468042 Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 22f11e29c4ad4712a54877b0895d28a4 Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeTestJSON-1475468042-project Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.921490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '7d7655de-fe79-4bbd-abb5-5908ef3acda9'} Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:02:29.922696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. Aug 30 01:02:29.924135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:02:29.925439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] Returning 404 to user: Instance 7d7655de-fe79-4bbd-abb5-5908ef3acda9 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:02:29.925439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ad5c5857-7b7c-4c52-8a8a-7cea8ac3adf7 tempest-AttachVolumeTestJSON-1475468042 tempest-AttachVolumeTestJSON-1475468042-project] 10.222.0.17 "GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9" status: 404 len: 111 microversion: 2.1 time: 0.030545 Aug 30 01:02:29.925439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 423/841] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:29 2022] GET /compute/v2.1/servers/7d7655de-fe79-4bbd-abb5-5908ef3acda9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:02:39.609277 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b40075d7-b5e0-4a76-a9b3-7d02bd813f15 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: .version_select at 0x7f03a2d671f0>, body: {"keypair": {"name": "tempest-keypair-1453043583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFkRBEvtW9+K3GjSbc+XHAlFLVFKMDAqTa4QVkA0TMIR12lEXtUEKysW+MdryVJ0UUQOzQSZQP+mnHm+wO2HS5CMidCbHZMF0a+4aZSJnPRflXYFpPHhZtHPWhj8Hd5MA=="}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:39.628852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-b40075d7-b5e0-4a76-a9b3-7d02bd813f15 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for project fe19812dff73433b8b29d24ddbea3f56. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:02:39.633120 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-b40075d7-b5e0-4a76-a9b3-7d02bd813f15 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for user 9d7babb2d721414496d45840f9253852 and project fe19812dff73433b8b29d24ddbea3f56. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:02:39.658676 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b40075d7-b5e0-4a76-a9b3-7d02bd813f15 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193900 Aug 30 01:02:39.659654 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 419/842] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 01:02:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:40.995749 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2005741786", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89b78a04-c7c4-429f-b8b3-b10b127267cb"}], "security_groups": [{"name": "tempest-securitygroup--915586277"}], "key_name": "tempest-keypair-1453043583", "user_data": "}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:41.006381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=65 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:41.007035 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=82 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:41.116932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] validate_networks() for [('89b78a04-c7c4-429f-b8b3-b10b127267cb', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:02:41.637621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:02:41.638382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:02:41.639121 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:02:41.639774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:02:41.640806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:02:41.649577 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.650429 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.650895 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.651800 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:41.652389 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:41.652861 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:41.671833 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for project fe19812dff73433b8b29d24ddbea3f56. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:02:41.675842 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for user 9d7babb2d721414496d45840f9253852 and project fe19812dff73433b8b29d24ddbea3f56. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:02:41.688305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:02:41.690650 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:02:41.739320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4af13eac-c547-4618-b7bd-b7f4b9820abd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.748137 Aug 30 01:02:41.746034 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 424/843] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:02:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:02:41.748664 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=34 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:41.754632 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-11bef6c7-d79f-4d56-bab5-29199aa7f0c7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:41.755597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-11bef6c7-d79f-4d56-bab5-29199aa7f0c7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:41.828716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-11bef6c7-d79f-4d56-bab5-29199aa7f0c7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:41.837722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-11bef6c7-d79f-4d56-bab5-29199aa7f0c7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1242 microversion: 2.1 time: 0.089907 Aug 30 01:02:41.838693 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 420/844] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:41 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:42.858381 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:42.859298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:42.865588 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:42.866112 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:42.866643 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:42.867421 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:42.867917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:42.868583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:42.958793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:42.970079 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5329b030-3158-4e51-8694-9b2c8e61e17f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1294 microversion: 2.1 time: 0.115857 Aug 30 01:02:42.984854 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 425/845] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:42 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1294 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:43.995347 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:43.996137 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:44.006539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:44.007069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:44.007509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:44.009237 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:44.009717 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:44.010648 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:44.176165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:44.190378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-af744dfe-a8c8-4507-87d6-167828694648 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1367 microversion: 2.1 time: 0.197752 Aug 30 01:02:44.203969 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 421/846] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:43 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:44.621660 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-27966ef0-81bc-4a95-ac86-aeb29c1e37d9 req-86ce738f-a2b9-42b0-b2db-a1e48f9c41e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe9a2cc-ace1-43b1-b535-23d338a9e2ab", "tag": "ab72e0f1-5f48-4a55-be78-cfee96f40413"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:44.638127 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-27966ef0-81bc-4a95-ac86-aeb29c1e37d9 req-86ce738f-a2b9-42b0-b2db-a1e48f9c41e5 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:44.638709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-27966ef0-81bc-4a95-ac86-aeb29c1e37d9 req-86ce738f-a2b9-42b0-b2db-a1e48f9c41e5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:44.639535 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-27966ef0-81bc-4a95-ac86-aeb29c1e37d9 req-86ce738f-a2b9-42b0-b2db-a1e48f9c41e5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:44.659344 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-27966ef0-81bc-4a95-ac86-aeb29c1e37d9 req-86ce738f-a2b9-42b0-b2db-a1e48f9c41e5 service nova] Creating event network-changed:ab72e0f1-5f48-4a55-be78-cfee96f40413 for instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab on hv-cinder-81574 Aug 30 01:02:44.666052 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-27966ef0-81bc-4a95-ac86-aeb29c1e37d9 req-86ce738f-a2b9-42b0-b2db-a1e48f9c41e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047593 Aug 30 01:02:44.666671 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 426/847] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:45.212805 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:45.213383 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:45.220503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:45.220993 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:45.221410 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:45.222110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:45.222603 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:45.223029 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:45.360267 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:45.368506 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-11c5951e-06b0-4dd6-8369-9076e0803c56 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1367 microversion: 2.1 time: 0.159736 Aug 30 01:02:45.369108 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 422/848] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:45 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:46.391343 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:46.392073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:46.402923 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:46.404096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:46.404537 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:46.406476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:46.407237 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:46.408026 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:46.600607 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:46.608583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4fb14d7e-c459-44f0-a022-47eb5c1762e2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1367 microversion: 2.1 time: 0.222449 Aug 30 01:02:46.626382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 427/849] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:46 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:47.629808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:47.630406 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:47.638063 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:47.638979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:47.639447 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:47.640157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:47.640610 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:47.641034 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:47.781754 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:47.789671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-612dbd01-2e4d-4e8d-a3e7-3ffa0e337c3d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1367 microversion: 2.1 time: 0.163967 Aug 30 01:02:47.790261 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 423/850] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:47 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:48.398355 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-07bb3055-615c-4b43-9d4c-59dd95697430 req-de659330-e474-4746-898b-ff46d9426de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe9a2cc-ace1-43b1-b535-23d338a9e2ab", "name": "network-vif-plugged", "status": "completed", "tag": "ab72e0f1-5f48-4a55-be78-cfee96f40413"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:48.408759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-07bb3055-615c-4b43-9d4c-59dd95697430 req-de659330-e474-4746-898b-ff46d9426de7 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:48.409492 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-07bb3055-615c-4b43-9d4c-59dd95697430 req-de659330-e474-4746-898b-ff46d9426de7 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:48.410106 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-07bb3055-615c-4b43-9d4c-59dd95697430 req-de659330-e474-4746-898b-ff46d9426de7 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:48.425906 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-07bb3055-615c-4b43-9d4c-59dd95697430 req-de659330-e474-4746-898b-ff46d9426de7 service nova] Creating event network-vif-plugged:ab72e0f1-5f48-4a55-be78-cfee96f40413 for instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab on hv-cinder-81574 Aug 30 01:02:48.431608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-07bb3055-615c-4b43-9d4c-59dd95697430 req-de659330-e474-4746-898b-ff46d9426de7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036885 Aug 30 01:02:48.432933 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 428/851] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:48.810257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:48.810841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:48.819265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:48.819753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:48.820182 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:48.820916 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:48.821331 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:48.821745 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:48.962664 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:48.971043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f4bc0f6b-4abb-41d8-a17f-a4140ed99ed2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1367 microversion: 2.1 time: 0.165071 Aug 30 01:02:48.974931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 424/852] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:48 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:49.992282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:49.992980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:50.000324 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:50.001006 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:50.001445 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:50.002249 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:50.002592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:50.003053 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:50.142123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:50.150769 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f8bafee0-a210-4c02-badb-1bdd567c25c6 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1367 microversion: 2.1 time: 0.162762 Aug 30 01:02:50.151372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 429/853] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:49 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:51.172689 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:51.173390 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:51.180625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:51.181101 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:51.181523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:51.183432 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:51.184225 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:51.184646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:51.329454 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:02:51.338787 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7dda4cd9-c5fd-4629-bf50-58732bbbea9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1557 microversion: 2.1 time: 0.169877 Aug 30 01:02:51.339391 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 425/854] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:02:51 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1557 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:02:51.360624 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:02:51.361766 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:02:51.373686 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:51.374052 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:51.374668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:51.376246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:51.376673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:51.377267 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:51.469274 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-08e88cc3-6cbc-4776-96a8-d51b0934ad49 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113477 Aug 30 01:02:51.470091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 430/855] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 30 01:02:51 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:02:52.517335 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:02:52.707700 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-845b3680-1159-427b-abca-7a7c1e4592fb req-3c7fbeae-7f00-48ce-9d48-ff3d6eac503c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe9a2cc-ace1-43b1-b535-23d338a9e2ab", "tag": "ab72e0f1-5f48-4a55-be78-cfee96f40413"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:02:52.719567 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-845b3680-1159-427b-abca-7a7c1e4592fb req-3c7fbeae-7f00-48ce-9d48-ff3d6eac503c service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:02:52.720458 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-845b3680-1159-427b-abca-7a7c1e4592fb req-3c7fbeae-7f00-48ce-9d48-ff3d6eac503c service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:02:52.721160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-845b3680-1159-427b-abca-7a7c1e4592fb req-3c7fbeae-7f00-48ce-9d48-ff3d6eac503c service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:02:52.734647 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-845b3680-1159-427b-abca-7a7c1e4592fb req-3c7fbeae-7f00-48ce-9d48-ff3d6eac503c service nova] Creating event network-changed:ab72e0f1-5f48-4a55-be78-cfee96f40413 for instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab on hv-cinder-81574 Aug 30 01:02:52.743044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-845b3680-1159-427b-abca-7a7c1e4592fb req-3c7fbeae-7f00-48ce-9d48-ff3d6eac503c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228393 Aug 30 01:02:52.743044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 426/856] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:09.235918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:09.236697 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:09.238576 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 01:03:09.238734 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Tue Aug 30 01:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-volume_attachments (ip 10.222.0.17) !!! Aug 30 01:03:09.239698 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:09.240427 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=28 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:09.244650 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:09.247291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:09.260292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:09.260837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:09.261641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:09.262440 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:09.262873 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:09.263319 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:09.296142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ead2b02a-642e-4310-999e-190c25adb7e0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060960 Aug 30 01:03:09.296715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 431/857] 10.222.0.17 () {60 vars in 1343 bytes} [Tue Aug 30 01:03:09 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:09.365769 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:09.366620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=32 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:09.372395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:09.372977 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:09.380620 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:09.381103 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:09.381531 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:09.382288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:09.382726 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:09.383091 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:09.421310 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:03:09.505319 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-96d5dc48-ae0b-4f3a-925a-7c010b1670d4 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "DELETE /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 204 len: 0 microversion: 2.20 time: 0.141130 Aug 30 01:03:09.506329 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 427/858] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 30 01:03:09 2022] DELETE /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:03:09.515995 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:09.516600 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:09.525903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:09.526518 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:09.527348 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:09.528085 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:09.528604 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:09.529016 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:09.670010 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:09.678444 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:09.679913 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:09.681075 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-49fb2dba-016b-4473-920f-83987077769d tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.170222 Aug 30 01:03:09.681991 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 432/859] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:03:09 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:03:10.706745 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:10.707381 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:10.717001 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:10.717619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:10.718152 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:10.719219 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:10.719856 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:10.720332 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:10.863718 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:10.872485 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:10.873918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:10.875282 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7504d021-1ccb-40d1-b597-aca082098f65 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.173168 Aug 30 01:03:10.875820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 428/860] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:03:10 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:03:11.898243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:11.898897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:11.906764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:11.907399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:11.907833 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:11.908585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:11.909042 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:11.909487 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:12.050757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:12.061985 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:12.063844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2a8b56e48b445709054849f4893767a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e36d98f444ec4d12a1a55ef450de63a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:12.065035 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f61e685c-36b1-4191-bfaf-47b134be71f0 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 200 len: 1724 microversion: 2.20 time: 0.170978 Aug 30 01:03:12.065598 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 433/861] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:03:11 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 01:03:12.290298 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-c9b78eb2-4aba-40b5-9237-7ff28d4b904f req-9c7f2bef-4322-419f-b4a3-edac31a84ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "292814e8-5ed9-4973-beb5-106bb39d79d8", "name": "network-vif-deleted", "tag": "38122c0f-dd5b-474a-bd39-f20d490b5a6f"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:12.301046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c9b78eb2-4aba-40b5-9237-7ff28d4b904f req-9c7f2bef-4322-419f-b4a3-edac31a84ec7 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:12.301977 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c9b78eb2-4aba-40b5-9237-7ff28d4b904f req-9c7f2bef-4322-419f-b4a3-edac31a84ec7 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:12.314288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c9b78eb2-4aba-40b5-9237-7ff28d4b904f req-9c7f2bef-4322-419f-b4a3-edac31a84ec7 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:12.330677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-c9b78eb2-4aba-40b5-9237-7ff28d4b904f req-9c7f2bef-4322-419f-b4a3-edac31a84ec7 service nova] Creating event network-vif-deleted:38122c0f-dd5b-474a-bd39-f20d490b5a6f for instance 292814e8-5ed9-4973-beb5-106bb39d79d8 on hv-cinder-81574 Aug 30 01:03:12.335859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-c9b78eb2-4aba-40b5-9237-7ff28d4b904f req-9c7f2bef-4322-419f-b4a3-edac31a84ec7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049332 Aug 30 01:03:12.337029 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 429/862] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:13.088194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:13.088802 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:13.095784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:13.096347 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:13.096946 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:13.097462 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:13.097911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:13.098324 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:13.112686 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] HTTP exception thrown: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Request method failure captured: Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 HTTP/1.1 Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWATEEZnk8p2SFyb9-vA8U2AmKZLs6y6M1r_XteV2aCo_ScnBGOW9QqavDLxzB2OuWN8zKG3vtIC2an9WjdcOcVRZ0gLeYeeOlG5j4a_aa49Bfs-sJ3ePxw9tdBewkS7fArCoJfSTGhyUeVxV0nwobD8WRYT4zHfRxKJyNde_GNrl0Y Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:03:13.114606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e36d98f444ec4d12a1a55ef450de63a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}] Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: f2a8b56e48b445709054849f4893767a Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:13.116240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '292814e8-5ed9-4973-beb5-106bb39d79d8'} Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:03:13.117011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:13.118917 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:13.120412 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Returning 404 to user: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:03:13.120412 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fa633ab6-dcd0-4d03-8c33-83a09df515ce tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 404 len: 111 microversion: 2.20 time: 0.031840 Aug 30 01:03:13.120412 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 434/863] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:03:13 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:03:13.126493 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-58709f1b-5a2b-4bf8-95d8-982396f32536 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '.version_select at 0x7f03a1e89dc0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:13.148038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-58709f1b-5a2b-4bf8-95d8-982396f32536 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554300659" status: 204 len: 0 microversion: 2.20 time: 0.025616 Aug 30 01:03:13.148769 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 430/864] 10.222.0.17 () {60 vars in 1262 bytes} [Tue Aug 30 01:03:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554300659 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 01:03:15.210096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:15.210668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:15.217641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.218142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.218572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.219304 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.219751 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.220167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.234664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] HTTP exception thrown: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Request method failure captured: Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: DELETE /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 HTTP/1.1 Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWATEEZnk8p2SFyb9-vA8U2AmKZLs6y6M1r_XteV2aCo_ScnBGOW9QqavDLxzB2OuWN8zKG3vtIC2an9WjdcOcVRZ0gLeYeeOlG5j4a_aa49Bfs-sJ3ePxw9tdBewkS7fArCoJfSTGhyUeVxV0nwobD8WRYT4zHfRxKJyNde_GNrl0Y Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:03:15.236246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e36d98f444ec4d12a1a55ef450de63a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}] Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: f2a8b56e48b445709054849f4893767a Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.237864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '292814e8-5ed9-4973-beb5-106bb39d79d8'} Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:03:15.238715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.240210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.241679 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Returning 404 to user: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:03:15.241679 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-202dfbfe-2ad9-4602-910c-ccb60383563f tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "DELETE /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 404 len: 111 microversion: 2.20 time: 0.031456 Aug 30 01:03:15.241679 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 435/865] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 30 01:03:15 2022] DELETE /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:03:15.249333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:15.250165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: 292814e8-5ed9-4973-beb5-106bb39d79d8] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:15.257159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.257622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.258045 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.258721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:15.259195 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:15.259610 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:15.273933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] HTTP exception thrown: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Request method failure captured: Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 HTTP/1.1 Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWATEEZnk8p2SFyb9-vA8U2AmKZLs6y6M1r_XteV2aCo_ScnBGOW9QqavDLxzB2OuWN8zKG3vtIC2an9WjdcOcVRZ0gLeYeeOlG5j4a_aa49Bfs-sJ3ePxw9tdBewkS7fArCoJfSTGhyUeVxV0nwobD8WRYT4zHfRxKJyNde_GNrl0Y Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:03:15.275601 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e36d98f444ec4d12a1a55ef450de63a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}] Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: f2a8b56e48b445709054849f4893767a Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.277324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '292814e8-5ed9-4973-beb5-106bb39d79d8'} Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:03:15.278305 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. Aug 30 01:03:15.280136 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:15.281441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Returning 404 to user: Instance 292814e8-5ed9-4973-beb5-106bb39d79d8 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:03:15.281441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-065897bc-e242-4d08-8faa-704708015ada tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8" status: 404 len: 111 microversion: 2.20 time: 0.034754 Aug 30 01:03:15.281441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 431/866] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:03:15 2022] GET /compute/v2.1/servers/292814e8-5ed9-4973-beb5-106bb39d79d8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:03:16.437976 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:16.438488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:16.445144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:16.445620 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:16.446049 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:16.446722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:16.447212 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:16.447629 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:16.461433 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] HTTP exception thrown: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Request method failure captured: Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: DELETE /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 HTTP/1.1 Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWATEEZnk8p2SFyb9-vA8U2AmKZLs6y6M1r_XteV2aCo_ScnBGOW9QqavDLxzB2OuWN8zKG3vtIC2an9WjdcOcVRZ0gLeYeeOlG5j4a_aa49Bfs-sJ3ePxw9tdBewkS7fArCoJfSTGhyUeVxV0nwobD8WRYT4zHfRxKJyNde_GNrl0Y Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:03:16.462988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e36d98f444ec4d12a1a55ef450de63a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}] Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: f2a8b56e48b445709054849f4893767a Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.464533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': 'fe7bbc0c-7d22-46e1-82f5-784e10ce23f3'} Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:03:16.465623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.467138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.468963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Returning 404 to user: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:03:16.468963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-26b12628-9f73-4575-b3e2-f74abff67465 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 404 len: 111 microversion: 2.20 time: 0.030422 Aug 30 01:03:16.468963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 436/867] 10.222.0.17 () {60 vars in 1280 bytes} [Tue Aug 30 01:03:16 2022] DELETE /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:03:16.473043 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:16.473642 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] [instance: fe7bbc0c-7d22-46e1-82f5-784e10ce23f3] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:16.479929 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:16.480460 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:16.480887 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:16.481569 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:16.482011 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:16.482426 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:16.496014 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] HTTP exception thrown: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Request method failure captured: Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 HTTP/1.1 Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWATEEZnk8p2SFyb9-vA8U2AmKZLs6y6M1r_XteV2aCo_ScnBGOW9QqavDLxzB2OuWN8zKG3vtIC2an9WjdcOcVRZ0gLeYeeOlG5j4a_aa49Bfs-sJ3ePxw9tdBewkS7fArCoJfSTGhyUeVxV0nwobD8WRYT4zHfRxKJyNde_GNrl0Y Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:03:16.497534 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e36d98f444ec4d12a1a55ef450de63a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e36d98f444ec4d12a1a55ef450de63a5"}]}] Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: e36d98f444ec4d12a1a55ef450de63a5 Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-918428797 Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: f2a8b56e48b445709054849f4893767a Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeShelveTestJSON-918428797-project Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.499314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'fe7bbc0c-7d22-46e1-82f5-784e10ce23f3'} Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:03:16.500242 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. Aug 30 01:03:16.501498 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:03:16.502607 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] Returning 404 to user: Instance fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:03:16.502607 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6619a056-091b-435a-a5a7-dad73333d363 tempest-AttachVolumeShelveTestJSON-918428797 tempest-AttachVolumeShelveTestJSON-918428797-project] 10.222.0.17 "GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3" status: 404 len: 111 microversion: 2.20 time: 0.029815 Aug 30 01:03:16.502607 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 432/868] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Aug 30 01:03:16 2022] GET /compute/v2.1/servers/fe7bbc0c-7d22-46e1-82f5-784e10ce23f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:03:24.544077 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0f455a69-f908-411b-89dc-082a581878bc tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1e21b80>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:24.594252 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0f455a69-f908-411b-89dc-082a581878bc tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/65c6a2dc-f8cc-4d66-b33f-152299259596" status: 200 len: 351 microversion: 2.1 time: 0.053663 Aug 30 01:03:24.595090 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 437/869] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 01:03:24 2022] GET /compute/v2.1/os-volumes/65c6a2dc-f8cc-4d66-b33f-152299259596 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:25.973479 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-01d6f3c0-4aef-4a2d-ad0f-7e1364b0082e tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a2d671f0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:26.030031 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-01d6f3c0-4aef-4a2d-ad0f-7e1364b0082e tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/be26ec49-e999-4be5-969b-f4b9af630bba" status: 200 len: 350 microversion: 2.1 time: 0.060036 Aug 30 01:03:26.030927 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 433/870] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 01:03:25 2022] GET /compute/v2.1/os-volumes/be26ec49-e999-4be5-969b-f4b9af630bba => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:27.393589 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=12 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:27.394369 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=24 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:27.399372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-589a5ce0-7a7f-4d96-8870-4202a2f6c043 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1f509d0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:27.455330 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-589a5ce0-7a7f-4d96-8870-4202a2f6c043 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/30614f57-f735-48a3-b6b8-c91ca984f446" status: 200 len: 351 microversion: 2.1 time: 0.063297 Aug 30 01:03:27.455734 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 438/871] 10.222.0.17 () {58 vars in 1245 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/os-volumes/30614f57-f735-48a3-b6b8-c91ca984f446 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:27.465222 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:27.465986 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:27.470465 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-24a853ec-6606-4579-87ef-b32bcfa4236b tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1f8f040>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:27.565699 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-24a853ec-6606-4579-87ef-b32bcfa4236b tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.101218 Aug 30 01:03:27.566392 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 434/872] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:27.580618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d42e7205-4f30-496a-bec3-4452d421d57b tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1d76f70>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:27.668439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d42e7205-4f30-496a-bec3-4452d421d57b tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091457 Aug 30 01:03:27.669659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 439/873] 10.222.0.17 () {58 vars in 1149 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:27.688123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-53bda738-638b-4cd5-884c-5fe1aedf123a tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1e1b0d0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:27.779521 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-53bda738-638b-4cd5-884c-5fe1aedf123a tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096059 Aug 30 01:03:27.780103 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 435/874] 10.222.0.17 () {58 vars in 1134 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:27.793847 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-01a1d2fd-78df-4ea3-980a-cb55f9bdfbf9 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1e2d8b0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:27.884188 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-01a1d2fd-78df-4ea3-980a-cb55f9bdfbf9 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.094409 Aug 30 01:03:27.884782 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 440/875] 10.222.0.17 () {58 vars in 1167 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:27.898345 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-6267f5bb-991c-4373-bfd1-0f1a47eed486 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1edcee0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:27.982920 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-6267f5bb-991c-4373-bfd1-0f1a47eed486 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088553 Aug 30 01:03:27.983542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 436/876] 10.222.0.17 () {58 vars in 1170 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:27.997182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-738938cb-8b75-4a7b-bbf0-4f8c1ca1fd38 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a2009c10>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:28.079400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-738938cb-8b75-4a7b-bbf0-4f8c1ca1fd38 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086177 Aug 30 01:03:28.079971 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 441/877] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Aug 30 01:03:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:28.092764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5ea559b3-dc02-403f-8c7a-b0e61544c8e4 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1e52ee0>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:28.186621 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5ea559b3-dc02-403f-8c7a-b0e61544c8e4 tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097593 Aug 30 01:03:28.187251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 437/878] 10.222.0.17 () {58 vars in 1188 bytes} [Tue Aug 30 01:03:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:28.200646 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-03547b4f-e1f0-43f7-b91c-ef18fca88b6f tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] Calling method '.version_select at 0x7f03a1f841f0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:28.289726 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-03547b4f-e1f0-43f7-b91c-ef18fca88b6f tempest-VolumesTestJSON-1998012783 tempest-VolumesTestJSON-1998012783-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092548 Aug 30 01:03:28.290614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 442/879] 10.222.0.17 () {58 vars in 1155 bytes} [Tue Aug 30 01:03:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:35.962097 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:35.962648 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:35.968915 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:35.969404 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:35.969829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:35.970513 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:35.970957 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:35.971406 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:35.995371 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-59ddb39e-2199-4283-b7bc-f04f839c030d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/ips" status: 200 len: 149 microversion: 2.1 time: 0.037953 Aug 30 01:03:35.995952 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 438/880] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 01:03:35 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:37.372566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baa9fa75-9f0d-4218-92fa-6f8cf1e5466e"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:37.374899 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:37.381213 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:37.381696 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:37.382156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:37.382850 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:37.383752 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:37.383752 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:37.661807 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-660e27bc-76e5-47f8-9200-a70540b8554d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294431 Aug 30 01:03:37.662690 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 443/881] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:03:37 2022] POST /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:44.205196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-787bf845-340b-408e-825b-95506f196b57 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: .version_select at 0x7f03a1edcaf0>, body: {"keypair": {"name": "tempest-keypair-900005581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqKMkZy4XrwFc8lvjExVkZF+auve4Cd8jh4I6cAKtukZAQ0bBrgX3eFfpEZ92FK58J56cel7ERkjfERY3Ricp6+zAA+NrpRD2yYqnmq+Q1RacN1mga1UqQ+OFhRFJNGJg=="}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:44.222740 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-787bf845-340b-408e-825b-95506f196b57 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for project fe19812dff73433b8b29d24ddbea3f56. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:03:44.226775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-787bf845-340b-408e-825b-95506f196b57 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for user 9d7babb2d721414496d45840f9253852 and project fe19812dff73433b8b29d24ddbea3f56. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:03:44.251480 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-787bf845-340b-408e-825b-95506f196b57 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050496 Aug 30 01:03:44.252056 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 439/882] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 01:03:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:45.645833 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-518419664", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89b78a04-c7c4-429f-b8b3-b10b127267cb"}], "security_groups": [{"name": "tempest-securitygroup--51006943"}], "key_name": "tempest-keypair-900005581", "user_data": "}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:45.761699 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] validate_networks() for [('89b78a04-c7c4-429f-b8b3-b10b127267cb', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:03:46.160282 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:03:46.160666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:03:46.161135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:03:46.161536 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:03:46.161967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:03:46.171083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.171560 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.171987 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.172731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:46.173176 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:46.173592 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:46.190770 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for project fe19812dff73433b8b29d24ddbea3f56. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:03:46.194782 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for user 9d7babb2d721414496d45840f9253852 and project fe19812dff73433b8b29d24ddbea3f56. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:03:46.206025 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:03:46.208471 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:03:46.257300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-439d9e6c-df88-4e11-9f47-ae56bf3ded9f tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.616581 Aug 30 01:03:46.258293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 444/883] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:03:45 2022] POST /compute/v2.1/servers => generated 400 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:03:46.269435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-023ce0f0-06fd-4dbf-8f21-f0356f091a04 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:46.270650 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-023ce0f0-06fd-4dbf-8f21-f0356f091a04 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:46.276252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=4 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:03:46.330965 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-023ce0f0-06fd-4dbf-8f21-f0356f091a04 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:46.338314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-023ce0f0-06fd-4dbf-8f21-f0356f091a04 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1240 microversion: 2.1 time: 0.072577 Aug 30 01:03:46.338885 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 440/884] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:46 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:47.359745 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:47.360377 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:47.371593 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.372101 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.372573 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.373566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:47.374313 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:47.374951 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:47.451162 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:47.459784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-043f8946-88cd-413a-8524-e279362511b7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1300 microversion: 2.1 time: 0.104265 Aug 30 01:03:47.473309 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 445/885] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:47 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:48.481747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:48.482996 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:48.489467 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:48.489932 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:48.490356 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:48.491057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:48.491670 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:48.492079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:48.631186 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:48.639214 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5f09286b-aa23-4bf3-8386-90cf25609429 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1364 microversion: 2.1 time: 0.161855 Aug 30 01:03:48.639788 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 441/886] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:48 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:48.967108 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-b5fed712-365b-4231-a56c-79a9764ad415 req-2cd079b7-93de-430f-9be7-ad003bc2e5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3180f7-92a4-4746-9b5a-d54b5a2c310e", "tag": "69527cb1-4f25-4b75-8471-0352f26084ac"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:48.978659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b5fed712-365b-4231-a56c-79a9764ad415 req-2cd079b7-93de-430f-9be7-ad003bc2e5db service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:48.979275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b5fed712-365b-4231-a56c-79a9764ad415 req-2cd079b7-93de-430f-9be7-ad003bc2e5db service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:48.980256 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b5fed712-365b-4231-a56c-79a9764ad415 req-2cd079b7-93de-430f-9be7-ad003bc2e5db service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:48.995066 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-b5fed712-365b-4231-a56c-79a9764ad415 req-2cd079b7-93de-430f-9be7-ad003bc2e5db service nova] Creating event network-changed:69527cb1-4f25-4b75-8471-0352f26084ac for instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e on hv-cinder-81574 Aug 30 01:03:49.001103 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-b5fed712-365b-4231-a56c-79a9764ad415 req-2cd079b7-93de-430f-9be7-ad003bc2e5db service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038008 Aug 30 01:03:49.002336 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 446/887] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:49.660248 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:49.660853 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:49.667838 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:49.668323 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:49.668753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:49.669448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:49.670063 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:49.670728 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:49.893979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:49.902516 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-eae2e7fb-fea3-4a0c-a14c-ca4e6b108579 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1364 microversion: 2.1 time: 0.246215 Aug 30 01:03:49.903345 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 442/888] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:49 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:50.391384 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:50.391967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:50.398006 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-e497ac6f-dc4e-4292-9fa7-c0ffb64a2f1d req-5e8fb208-350e-4792-aaf1-c6076b96c07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f572fa1-3226-46e6-9899-4fcf86fd92f1", "tag": "073c1fdc-8ca9-494e-8140-91ded92f4916"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:50.401089 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.403821 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.405541 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.407494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.407950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e497ac6f-dc4e-4292-9fa7-c0ffb64a2f1d req-5e8fb208-350e-4792-aaf1-c6076b96c07a service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.408637 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e497ac6f-dc4e-4292-9fa7-c0ffb64a2f1d req-5e8fb208-350e-4792-aaf1-c6076b96c07a service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.409395 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.410785 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.414679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-e497ac6f-dc4e-4292-9fa7-c0ffb64a2f1d req-5e8fb208-350e-4792-aaf1-c6076b96c07a service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.427877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-e497ac6f-dc4e-4292-9fa7-c0ffb64a2f1d req-5e8fb208-350e-4792-aaf1-c6076b96c07a service nova] Creating event network-changed:073c1fdc-8ca9-494e-8140-91ded92f4916 for instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 on hv-cinder-81574 Aug 30 01:03:50.434751 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-e497ac6f-dc4e-4292-9fa7-c0ffb64a2f1d req-5e8fb208-350e-4792-aaf1-c6076b96c07a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045190 Aug 30 01:03:50.436005 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 443/889] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:50.464015 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:03:50.627458 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2a3b204e-49c6-4aff-935e-846253f96a8d tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 204 len: 0 microversion: 2.1 time: 0.238098 Aug 30 01:03:50.633867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 447/890] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:03:50 2022] DELETE /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:03:50.644641 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:50.644641 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:50.650874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.651391 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.651825 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.652532 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.652993 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.653400 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.797605 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:50.806071 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ec8be172-f723-4637-b335-a37037ff594e tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.170671 Aug 30 01:03:50.807334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 444/891] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:50 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:50.924272 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:50.926129 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:50.933697 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.934515 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.935089 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:50.935961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:50.936685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:50.937192 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:51.088990 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:51.096963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b3b4f86b-aea5-496d-8620-ec5e1674f840 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1364 microversion: 2.1 time: 0.177185 Aug 30 01:03:51.097544 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 448/892] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:50 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:51.829015 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:51.829622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:51.836819 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:51.837318 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:51.837774 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:51.838652 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:51.839485 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:51.839910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.062785 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:52.071640 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7a9116e8-1aca-49b7-ad00-f941ee93d508 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1569 microversion: 2.1 time: 0.247264 Aug 30 01:03:52.073336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 445/893] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:51 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:52.119855 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:52.120558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:52.127797 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.128404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.128834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.129539 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.129987 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.130407 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.396222 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:52.407708 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-76ce16f8-de48-4c1f-89ce-cf546e072e32 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1364 microversion: 2.1 time: 0.292384 Aug 30 01:03:52.408412 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 449/894] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:52 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:52.745341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-b5ccc54a-6e39-40b5-b3b4-d9b087b4daf5 req-a5298d5d-8f6e-49d1-b6c7-02f2e6843fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3180f7-92a4-4746-9b5a-d54b5a2c310e", "name": "network-vif-plugged", "status": "completed", "tag": "69527cb1-4f25-4b75-8471-0352f26084ac"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:52.755152 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b5ccc54a-6e39-40b5-b3b4-d9b087b4daf5 req-a5298d5d-8f6e-49d1-b6c7-02f2e6843fb3 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.755623 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b5ccc54a-6e39-40b5-b3b4-d9b087b4daf5 req-a5298d5d-8f6e-49d1-b6c7-02f2e6843fb3 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.756054 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b5ccc54a-6e39-40b5-b3b4-d9b087b4daf5 req-a5298d5d-8f6e-49d1-b6c7-02f2e6843fb3 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.757769 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-102eb9ae-8cd1-4d3f-83d9-fa5c72398541 req-113f04e1-b21b-4a27-a5c0-3f003b01f892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f572fa1-3226-46e6-9899-4fcf86fd92f1", "name": "network-vif-deleted", "tag": "073c1fdc-8ca9-494e-8140-91ded92f4916"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:52.771135 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-b5ccc54a-6e39-40b5-b3b4-d9b087b4daf5 req-a5298d5d-8f6e-49d1-b6c7-02f2e6843fb3 service nova] Creating event network-vif-plugged:69527cb1-4f25-4b75-8471-0352f26084ac for instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e on hv-cinder-81574 Aug 30 01:03:52.778346 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-b5ccc54a-6e39-40b5-b3b4-d9b087b4daf5 req-a5298d5d-8f6e-49d1-b6c7-02f2e6843fb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036986 Aug 30 01:03:52.779710 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 446/895] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:03:52.787939 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-102eb9ae-8cd1-4d3f-83d9-fa5c72398541 req-113f04e1-b21b-4a27-a5c0-3f003b01f892 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:52.788457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-102eb9ae-8cd1-4d3f-83d9-fa5c72398541 req-113f04e1-b21b-4a27-a5c0-3f003b01f892 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:52.788895 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-102eb9ae-8cd1-4d3f-83d9-fa5c72398541 req-113f04e1-b21b-4a27-a5c0-3f003b01f892 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:52.826651 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-102eb9ae-8cd1-4d3f-83d9-fa5c72398541 req-113f04e1-b21b-4a27-a5c0-3f003b01f892 service nova] Creating event network-vif-deleted:073c1fdc-8ca9-494e-8140-91ded92f4916 for instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 on hv-cinder-81574 Aug 30 01:03:52.836096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-102eb9ae-8cd1-4d3f-83d9-fa5c72398541 req-113f04e1-b21b-4a27-a5c0-3f003b01f892 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089553 Aug 30 01:03:52.836714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 450/896] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:53.097446 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:53.099211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:53.107165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.107730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.108438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.109213 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.109717 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.111039 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.201768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:53.220831 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8e9a361b-7aa7-42ee-a404-2c2bff99a5c6 tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1219 microversion: 2.1 time: 0.130486 Aug 30 01:03:53.221418 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 447/897] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:53 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:03:53.440204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:53.440886 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:53.451073 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.451809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.452320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.453181 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:53.454285 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:53.454695 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:53.627858 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:53.636084 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-44f5b3e0-a06f-447c-a4dc-7a7816102095 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1364 microversion: 2.1 time: 0.209000 Aug 30 01:03:53.636658 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 451/898] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:53 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:54.243263 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:54.244076 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.251694 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.252187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.252626 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.253332 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.253830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.254439 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.290639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.291195 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.292464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.292933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lazy-loading 'fault' on Instance uuid 6f572fa1-3226-46e6-9899-4fcf86fd92f1 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:03:54.407501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558d42f4c7f437495af05d4c8c42e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b0736ff08ae4fa6be73ec678c98077f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:54.416177 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c401495f-8d1f-47e8-b79f-6efc63d6826a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 200 len: 1224 microversion: 2.1 time: 0.176447 Aug 30 01:03:54.417288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 448/899] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:54 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 1224 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:54.657210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:54.657827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.664664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.665639 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.666569 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.667541 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.668157 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.669320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.829019 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:03:54.840793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2178aa94-7aeb-4554-b529-e7c8039f5afb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1555 microversion: 2.1 time: 0.187526 Aug 30 01:03:54.841671 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 452/900] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:54 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:03:54.862624 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:54.863150 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:54.869812 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.869812 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.870274 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.870962 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:54.871435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:54.871854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:54.961850 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-55ab9c03-549e-46c0-8feb-4955d0ea1212 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103203 Aug 30 01:03:54.962447 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 449/901] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 30 01:03:54 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:03:55.437883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:55.438487 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] [instance: 6f572fa1-3226-46e6-9899-4fcf86fd92f1] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:03:55.444644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:55.445123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:55.445551 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:55.446234 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:55.446656 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:55.447117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:55.460885 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] HTTP exception thrown: Instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 could not be found. Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Request method failure captured: Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 HTTP/1.1 Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWCuGxf8JLREIvmr0hg-B23CuZ4-3vtgmOvrhUmXAaEz4AiiZObgCHeoTtjUD1NluqG25h0eXhqwY1QCz8m4UPRKX3G_Q70G_Jx9LdrAihB0WKwkXBl14LF2YRkFQ5y5BBDxxXI44152keopRaPpRY-80rbTC1W-zldiGzQC5sk8lxA Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: 2b0736ff08ae4fa6be73ec678c98077f Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-TestShelveInstance-1303412661 Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:03:55.462530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b0736ff08ae4fa6be73ec678c98077f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b0736ff08ae4fa6be73ec678c98077f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b0736ff08ae4fa6be73ec678c98077f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b0736ff08ae4fa6be73ec678c98077f"}]}] Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-TestShelveInstance-1303412661 Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: 2b0736ff08ae4fa6be73ec678c98077f Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-TestShelveInstance-1303412661 Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-TestShelveInstance-1303412661-project Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 1558d42f4c7f437495af05d4c8c42e6e Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-TestShelveInstance-1303412661-project Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 could not be found. Aug 30 01:03:55.464295 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '6f572fa1-3226-46e6-9899-4fcf86fd92f1'} Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 could not be found. Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:03:55.465193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 could not be found. Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 could not be found. Aug 30 01:03:55.466522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:03:55.468532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Returning 404 to user: Instance 6f572fa1-3226-46e6-9899-4fcf86fd92f1 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:03:55.468532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-aa94d476-8fcf-49a9-b10c-b4a272ae17fd tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1" status: 404 len: 111 microversion: 2.1 time: 0.030091 Aug 30 01:03:55.468532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 453/902] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:03:55 2022] GET /compute/v2.1/servers/6f572fa1-3226-46e6-9899-4fcf86fd92f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:03:55.649246 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3bafe146-65b5-4103-a5b8-4d7bcdf1c68a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] Calling method '.version_select at 0x7f03a1d52d30>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:03:55.680342 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3bafe146-65b5-4103-a5b8-4d7bcdf1c68a tempest-TestShelveInstance-1303412661 tempest-TestShelveInstance-1303412661-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1989786991" status: 202 len: 0 microversion: 2.1 time: 0.035847 Aug 30 01:03:55.686842 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 450/903] 10.222.0.17 () {58 vars in 1254 bytes} [Tue Aug 30 01:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1989786991 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:03:56.006560 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-b2237f70-2cc2-4ea4-83d2-5626f29fd244 req-5ccafdfb-b063-4b9e-a3c2-fef75f6aa228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3180f7-92a4-4746-9b5a-d54b5a2c310e", "tag": "69527cb1-4f25-4b75-8471-0352f26084ac"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:03:56.020189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b2237f70-2cc2-4ea4-83d2-5626f29fd244 req-5ccafdfb-b063-4b9e-a3c2-fef75f6aa228 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:03:56.020825 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b2237f70-2cc2-4ea4-83d2-5626f29fd244 req-5ccafdfb-b063-4b9e-a3c2-fef75f6aa228 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:03:56.021366 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-b2237f70-2cc2-4ea4-83d2-5626f29fd244 req-5ccafdfb-b063-4b9e-a3c2-fef75f6aa228 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:03:56.039339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-b2237f70-2cc2-4ea4-83d2-5626f29fd244 req-5ccafdfb-b063-4b9e-a3c2-fef75f6aa228 service nova] Creating event network-changed:69527cb1-4f25-4b75-8471-0352f26084ac for instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e on hv-cinder-81574 Aug 30 01:03:56.045642 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-b2237f70-2cc2-4ea4-83d2-5626f29fd244 req-5ccafdfb-b063-4b9e-a3c2-fef75f6aa228 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043040 Aug 30 01:03:56.047187 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 454/904] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:31.164065 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:31.165653 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=46 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:31.166528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:31.172086 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:31.172511 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:31.181366 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.181888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.182313 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.182998 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.183843 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.184290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.210035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cb149788-9d2a-4315-ad35-0d6776527361 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e/ips" status: 200 len: 151 microversion: 2.1 time: 0.046890 Aug 30 01:04:31.210606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 451/905] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 01:04:31 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:31.226845 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baa9fa75-9f0d-4218-92fa-6f8cf1e5466e"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:31.230641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:31.232967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:31.233736 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:31.234372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:31.234965 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:31.242064 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.242533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.242955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.243659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.244097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.244506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.327575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Invalid volume: volume baa9fa75-9f0d-4218-92fa-6f8cf1e5466e is already attached to instances: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: POST /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e/os-volume_attachments HTTP/1.1 Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 74 Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:04:31.329298 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {"volumeAttachment": {"volumeId": "baa9fa75-9f0d-4218-92fa-6f8cf1e5466e"}} Aug 30 01:04:31.330948 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Invalid volume: volume baa9fa75-9f0d-4218-92fa-6f8cf1e5466e is already attached to instances: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'server_id': '0d3180f7-92a4-4746-9b5a-d54b5a2c310e', 'body': {'volumeAttachment': {'volumeId': 'baa9fa75-9f0d-4218-92fa-6f8cf1e5466e'}}} Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume baa9fa75-9f0d-4218-92fa-6f8cf1e5466e is already attached to instances: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:31.332927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume baa9fa75-9f0d-4218-92fa-6f8cf1e5466e is already attached to instances: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:31.334457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:31.336040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:31.336040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:31.336040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:31.336040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume baa9fa75-9f0d-4218-92fa-6f8cf1e5466e is already attached to instances: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab Aug 30 01:04:31.336040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:31.336040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 400 to user: Invalid volume: volume baa9fa75-9f0d-4218-92fa-6f8cf1e5466e is already attached to instances: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:31.336040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-aede2691-8604-4500-84c1-b20754d6d128 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111125 Aug 30 01:04:31.336040 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 455/906] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:04:31 2022] POST /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:04:31.339899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:31.340501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:31.347174 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.347621 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.348044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.348729 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.349206 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.349619 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.376333 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:04:31.460234 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8f31db36-64e8-4788-9e5c-7e261d444e64 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 204 len: 0 microversion: 2.1 time: 0.123872 Aug 30 01:04:31.460899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 452/907] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:04:31 2022] DELETE /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:04:31.471227 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:31.472417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:31.480268 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.480744 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.481505 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.482247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:31.482693 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:31.483140 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:31.624890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:31.632812 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-691da24b-9538-4264-bb5c-fd7b732c07b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1680 microversion: 2.1 time: 0.166455 Aug 30 01:04:31.633357 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 456/908] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:31 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:32.655819 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:32.656621 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:32.664018 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:32.664549 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:32.665093 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:32.665779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:32.666273 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:32.666734 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:32.804731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:32.817706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1cf64c45-0ea0-4331-8cfb-9c4e66ce1c60 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1680 microversion: 2.1 time: 0.166797 Aug 30 01:04:32.818487 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 453/909] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:32 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:33.842342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:33.842962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:33.849516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:33.849988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:33.850458 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:33.851267 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:33.851757 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:33.852196 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:34.039047 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:34.048685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-bd3b4029-d8a1-494f-96b2-578e5976e07e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 200 len: 1680 microversion: 2.1 time: 0.210490 Aug 30 01:04:34.049547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 457/910] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:33 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:34.338731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-206293698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-694307074", "security_groups": [{"name": "tempest-secgroup-smoke-1699795873"}], "block_device_mapping_v2": [{"uuid": "424318cd-4453-4c8e-aef2-b90c328877f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3714421d-bb5b-438f-b69d-78d97ba32811"}]}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:34.381886 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-47fc7538-a234-4836-b40f-b4e467b126ba req-084973a3-7661-4e22-86f5-1fe3402f9298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3180f7-92a4-4746-9b5a-d54b5a2c310e", "name": "network-vif-deleted", "tag": "69527cb1-4f25-4b75-8471-0352f26084ac"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:34.394488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-47fc7538-a234-4836-b40f-b4e467b126ba req-084973a3-7661-4e22-86f5-1fe3402f9298 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:34.395769 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-47fc7538-a234-4836-b40f-b4e467b126ba req-084973a3-7661-4e22-86f5-1fe3402f9298 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:34.396302 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-47fc7538-a234-4836-b40f-b4e467b126ba req-084973a3-7661-4e22-86f5-1fe3402f9298 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:34.412901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-47fc7538-a234-4836-b40f-b4e467b126ba req-084973a3-7661-4e22-86f5-1fe3402f9298 service nova] Creating event network-vif-deleted:69527cb1-4f25-4b75-8471-0352f26084ac for instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e on hv-cinder-81574 Aug 30 01:04:34.425218 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-47fc7538-a234-4836-b40f-b4e467b126ba req-084973a3-7661-4e22-86f5-1fe3402f9298 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046670 Aug 30 01:04:34.426069 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 458/911] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:04:34.519696 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] validate_networks() for [('3714421d-bb5b-438f-b69d-78d97ba32811', None, None, None, None, None)] {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:04:35.073254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:35.074639 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:35.081845 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:35.082331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:35.082761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:35.083498 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:35.083947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:35.084365 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:35.099689 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e HTTP/1.1 Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:04:35.101349 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:04:35.102932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '0d3180f7-92a4-4746-9b5a-d54b5a2c310e'} Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:35.103789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:04:35.105327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:04:35.108414 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:35.109502 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-152d9616-b0b2-4777-b3a9-876af293ee30 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 404 len: 111 microversion: 2.1 time: 0.041199 Aug 30 01:04:35.110493 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 459/912] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:35 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:04:35.118257 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e8eee2f4-d84a-4940-817e-0689278ed974 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '.version_select at 0x7f03a1f508b0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:35.150402 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e8eee2f4-d84a-4940-817e-0689278ed974 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-900005581" status: 202 len: 0 microversion: 2.1 time: 0.035696 Aug 30 01:04:35.150989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 460/913] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 30 01:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-900005581 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 01:04:35.273684 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:04:35.274069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:04:35.276505 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:04:35.276977 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:04:35.277383 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:04:35.287589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:35.288059 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:35.288508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:35.289614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:35.289797 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:35.290060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:35.309183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Getting quotas for project d4baca9d3a3e45d883482957e9ce8cb0. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:04:35.314112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Getting quotas for user 455284c947254207a719459efc031bea and project d4baca9d3a3e45d883482957e9ce8cb0. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:04:35.384055 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:04:35.386191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='424318cd-4453-4c8e-aef2-b90c328877f6',volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:04:35.572007 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4d4a4b29-cbad-4d51-b7e1-560921922316 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.237286 Aug 30 01:04:35.573655 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 454/914] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:04:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:04:35.584514 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4a62d2c9-2f16-4e7b-8a9e-d7989ca36c2a tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:35.584984 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4a62d2c9-2f16-4e7b-8a9e-d7989ca36c2a tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:35.649204 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4a62d2c9-2f16-4e7b-8a9e-d7989ca36c2a tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:35.657423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4a62d2c9-2f16-4e7b-8a9e-d7989ca36c2a tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1093 microversion: 2.1 time: 0.076855 Aug 30 01:04:35.658333 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 461/915] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:35 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:35.960032 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:35.960520 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:35.967767 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:35.968247 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:35.968685 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:35.969374 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:35.969826 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:35.970243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:36.065350 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lazy-loading 'services' on Instance uuid fbe9a2cc-ace1-43b1-b535-23d338a9e2ab {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:04:36.141300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-3d55583c-4475-4966-9096-421b47415a34 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-volume_attachments/baa9fa75-9f0d-4218-92fa-6f8cf1e5466e" status: 202 len: 0 microversion: 2.1 time: 0.186022 Aug 30 01:04:36.141898 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 455/916] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:04:35 2022] DELETE /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-volume_attachments/baa9fa75-9f0d-4218-92fa-6f8cf1e5466e => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:04:36.150654 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:36.155854 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:36.163154 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:36.163638 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:36.164080 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:36.164800 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:36.165250 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:36.165668 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:36.198800 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b8a8e3af-ea2a-49c3-aa5c-9a9392e312b0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052148 Aug 30 01:04:36.199391 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 462/917] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:04:36 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:36.678624 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:36.679245 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:36.687021 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:36.687508 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:36.687941 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:36.688816 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:36.689269 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:36.689691 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:36.762200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:36.770507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ea66ca76-218b-43ce-b259-d7e4b49c4546 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1191 microversion: 2.1 time: 0.096302 Aug 30 01:04:36.771065 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 456/918] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:36 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:37.211809 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:37.214023 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:37.221056 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.221540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.221964 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.222644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.223144 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.223744 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.255602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-105a9d47-b806-486d-b42b-7109eca41904 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048013 Aug 30 01:04:37.256280 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 463/919] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:04:37 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:04:37.321847 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:37.322340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:37.328713 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.329282 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.329711 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.330397 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.330844 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.331282 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.357252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:04:37.445255 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f4d9b730-4f72-4d28-a519-82a568ac9077 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 204 len: 0 microversion: 2.1 time: 0.126752 Aug 30 01:04:37.446124 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 457/920] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:04:37 2022] DELETE /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:04:37.454927 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:37.455571 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:37.461919 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.462479 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.462898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.463959 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.464413 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.464834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.667432 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:37.675449 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b4b0e568-2686-409a-a1f6-0a23dafca53e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1681 microversion: 2.1 time: 0.224555 Aug 30 01:04:37.676007 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 464/921] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:37 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:04:37.792698 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:37.793477 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:37.800503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.800960 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.802309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.803988 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:37.804614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:37.805201 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:37.954037 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:37.962621 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5c7e0f79-05e0-4427-9c85-eb4a6c8be9a0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1277 microversion: 2.1 time: 0.174339 Aug 30 01:04:37.963200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 458/922] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:37 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:38.701575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:38.702146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:38.709027 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:38.709503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:38.709926 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:38.710609 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:38.711054 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:38.711504 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:38.902289 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:38.911739 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-709f3e8b-08c5-43e2-9942-cf5a6960a905 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1681 microversion: 2.1 time: 0.216632 Aug 30 01:04:38.912360 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 465/923] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:38 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:38.983834 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:38.984390 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:38.990944 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:38.991477 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:38.991915 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:38.992614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:38.993064 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:38.993483 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:39.220864 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:39.229000 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1d08074d-e77a-4464-9aa5-9699b77df8c3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.249501 Aug 30 01:04:39.229854 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 459/924] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:38 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:39.826523 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-1b4fa137-0836-4bd6-a622-7eab7844f73a req-76c9b636-c4f2-4658-aceb-dcb5e03c147d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e56311d-801a-4a0d-bf3d-92f1fb67631e", "tag": "357c4443-3206-42f6-8545-ce0a1c38efe6"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:39.838311 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-1b4fa137-0836-4bd6-a622-7eab7844f73a req-76c9b636-c4f2-4658-aceb-dcb5e03c147d service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:39.838810 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-1b4fa137-0836-4bd6-a622-7eab7844f73a req-76c9b636-c4f2-4658-aceb-dcb5e03c147d service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:39.839317 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-1b4fa137-0836-4bd6-a622-7eab7844f73a req-76c9b636-c4f2-4658-aceb-dcb5e03c147d service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:39.853195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-1b4fa137-0836-4bd6-a622-7eab7844f73a req-76c9b636-c4f2-4658-aceb-dcb5e03c147d service nova] Creating event network-changed:357c4443-3206-42f6-8545-ce0a1c38efe6 for instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e on hv-cinder-81574 Aug 30 01:04:39.859798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-1b4fa137-0836-4bd6-a622-7eab7844f73a req-76c9b636-c4f2-4658-aceb-dcb5e03c147d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037107 Aug 30 01:04:39.860850 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 466/925] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:39.934144 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:39.934740 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:39.941648 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:39.942127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:39.942673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:39.943403 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:39.943846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:39.944257 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:40.232211 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:40.241046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8fe2fd20-e0c6-4c3a-8add-097fc7dbe940 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1681 microversion: 2.1 time: 0.311374 Aug 30 01:04:40.241763 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 460/926] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:39 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:40.260118 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:40.260837 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:40.267872 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:40.268352 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:40.268781 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:40.269473 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:40.269919 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:40.270334 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:40.610238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:40.618547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8525aab3-ca3d-4f52-b46e-3d6669251d46 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.363444 Aug 30 01:04:40.619396 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 467/927] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:40 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:41.265715 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:41.266321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:41.273196 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:41.273682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:41.274121 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:41.274879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:41.275375 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:41.275799 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:41.309053 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:41.309530 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:41.310075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:41.310643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lazy-loading 'fault' on Instance uuid fbe9a2cc-ace1-43b1-b535-23d338a9e2ab {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:04:41.353083 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:41.361137 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0aec0be1-9dd3-4b24-8aef-987f8ca6f177 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 200 len: 1332 microversion: 2.1 time: 0.099463 Aug 30 01:04:41.361690 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 461/928] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:41 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:41.639886 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:41.640584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:41.648098 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:41.648662 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:41.649332 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:41.650128 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:41.650674 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:41.651217 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:41.886654 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-a77c0493-0acf-416f-85f4-1c6e8f2fc7e7 req-22db91c9-d303-407e-b8c4-1469f2a52c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe9a2cc-ace1-43b1-b535-23d338a9e2ab", "name": "network-vif-deleted", "tag": "ab72e0f1-5f48-4a55-be78-cfee96f40413"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:41.896763 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a77c0493-0acf-416f-85f4-1c6e8f2fc7e7 req-22db91c9-d303-407e-b8c4-1469f2a52c18 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:41.897243 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a77c0493-0acf-416f-85f4-1c6e8f2fc7e7 req-22db91c9-d303-407e-b8c4-1469f2a52c18 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:41.897677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a77c0493-0acf-416f-85f4-1c6e8f2fc7e7 req-22db91c9-d303-407e-b8c4-1469f2a52c18 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:41.909964 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-a77c0493-0acf-416f-85f4-1c6e8f2fc7e7 req-22db91c9-d303-407e-b8c4-1469f2a52c18 service nova] Creating event network-vif-deleted:ab72e0f1-5f48-4a55-be78-cfee96f40413 for instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab on hv-cinder-81574 Aug 30 01:04:41.914997 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-a77c0493-0acf-416f-85f4-1c6e8f2fc7e7 req-22db91c9-d303-407e-b8c4-1469f2a52c18 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Aug 30 01:04:41.915926 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 462/929] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:41.945275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:41.953965 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6ece16f8-9a4c-457e-86c8-01957b278df3 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.318332 Aug 30 01:04:41.954547 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 468/930] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:41 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:42.388395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:42.389505 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:42.399316 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:42.400758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:42.400758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:42.401008 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:42.401429 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:42.401855 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:42.426845 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab HTTP/1.1 Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:04:42.428592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:04:42.430218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'fbe9a2cc-ace1-43b1-b535-23d338a9e2ab'} Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:04:42.431158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:04:42.432535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:04:42.434241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:04:42.434241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-89493a48-da4a-4ade-a215-78ddef0062ca tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 404 len: 111 microversion: 2.1 time: 0.049689 Aug 30 01:04:42.434241 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 463/931] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:42 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:04:42.440673 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cc9d47b6-252a-491c-bbdd-6206eed72dbd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '.version_select at 0x7f03a20430d0>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:42.466503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-cc9d47b6-252a-491c-bbdd-6206eed72dbd tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453043583" status: 202 len: 0 microversion: 2.1 time: 0.030382 Aug 30 01:04:42.467142 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 469/932] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 30 01:04:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453043583 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:04:42.975346 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:42.976041 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:42.982766 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:42.983284 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:42.983718 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:42.984426 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:42.984876 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:42.985295 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:43.150663 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ec632795-e474-4cfe-944b-47b9da3055b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: .version_select at 0x7f03a1e21820>, body: {"keypair": {"name": "tempest-keypair-1358519481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHs3N8pIKlOMGt+B8IociXpheSFGymz6XR5GIVgtJaoBk93fFnSVmrAEER3jnTEdJCWEazVPW9LZQLsgARUxZQ8UXTbNs5AlDJubQ5vULaYUdUauCj/7AblUrpVaAuK7mA=="}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:43.166720 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-ec632795-e474-4cfe-944b-47b9da3055b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for project fe19812dff73433b8b29d24ddbea3f56. Resources: {'key_pairs'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:04:43.171323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-ec632795-e474-4cfe-944b-47b9da3055b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for user 9d7babb2d721414496d45840f9253852 and project fe19812dff73433b8b29d24ddbea3f56. Resources: {'key_pairs'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:04:43.185475 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:43.193463 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4c57d91d-c24b-4de3-8058-6b7d0e6234a9 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.223529 Aug 30 01:04:43.194244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 464/933] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:42 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:43.195383 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ec632795-e474-4cfe-944b-47b9da3055b2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049151 Aug 30 01:04:43.201963 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 470/934] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 01:04:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:44.216987 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:44.217577 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:44.224410 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:44.224893 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:44.225316 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:44.226023 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:44.226464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:44.226880 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:44.245164 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:44.449739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:44.458262 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-220399c5-9815-4f8d-b452-39ab1a9f08c2 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.245442 Aug 30 01:04:44.459064 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 465/935] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:44 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:44.590463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1960772113", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89b78a04-c7c4-429f-b8b3-b10b127267cb"}], "security_groups": [{"name": "tempest-securitygroup--345658659"}], "key_name": "tempest-keypair-1358519481", "user_data": "}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:44.710110 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] validate_networks() for [('89b78a04-c7c4-429f-b8b3-b10b127267cb', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:04:45.099900 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:04:45.100410 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:04:45.100923 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:04:45.101553 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:04:45.102227 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:04:45.115497 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:45.116227 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:45.116798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:45.117901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:45.118572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:45.119238 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:45.138749 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for project fe19812dff73433b8b29d24ddbea3f56. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:04:45.143367 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for user 9d7babb2d721414496d45840f9253852 and project fe19812dff73433b8b29d24ddbea3f56. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:04:45.155989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:04:45.158250 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:04:45.218277 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7d082f81-42f8-461e-a2be-382c1b85d841 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.632730 Aug 30 01:04:45.218936 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 471/936] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:04:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:04:45.229873 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-68ba6783-ed3a-460d-a323-e94aa71666b3 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:45.230479 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-68ba6783-ed3a-460d-a323-e94aa71666b3 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:45.285450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-68ba6783-ed3a-460d-a323-e94aa71666b3 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:45.292507 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-68ba6783-ed3a-460d-a323-e94aa71666b3 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1242 microversion: 2.1 time: 0.066412 Aug 30 01:04:45.293046 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 466/937] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:45 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:45.479447 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:45.480140 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:45.487057 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:45.487551 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:45.487988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:45.488666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:45.489108 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:45.489529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:45.628684 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:45.637476 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-6b007b78-0744-4dfa-ac99-14f4f31b7925 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.162043 Aug 30 01:04:45.638127 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 472/938] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:45 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:46.315833 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:46.316533 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:46.318674 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:46.328007 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:46.328604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:46.329141 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:46.330029 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:46.330588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:46.331131 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:46.409355 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:46.419703 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-90229922-a276-42ef-8326-51ccfbb8726a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1294 microversion: 2.1 time: 0.108791 Aug 30 01:04:46.420287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 467/939] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:46 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:46.720759 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:46.721457 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:46.730574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:46.731205 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:46.731736 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:46.732666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:46.733087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:46.733793 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:46.936750 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:46.946212 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-24d121af-74db-4e27-8e1f-8f2d67251453 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.231156 Aug 30 01:04:46.947152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 473/940] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:46 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:47.460265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:47.460878 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:47.468616 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:47.469099 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:47.469530 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:47.470233 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:47.470680 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:47.471127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:47.548859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:47.556818 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-46c66444-adc7-4149-90e4-4d3975f50f97 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1300 microversion: 2.1 time: 0.100555 Aug 30 01:04:47.557599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 468/941] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:47 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:47.968367 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:47.968979 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:47.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:47.976698 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:47.977115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:47.977815 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:47.978267 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:47.978665 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:48.202881 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:48.211402 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fa50e1da-9454-4f61-aa29-736c013da23d tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.247012 Aug 30 01:04:48.211988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 474/942] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:47 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:48.404965 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-d3a17c31-cd0f-4048-8ff1-0cef4a2e23d2 req-0e143534-ca9c-42c9-89be-6ab075cb15cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250c1856-e84e-4823-975c-af13f060c627", "tag": "867f9c8e-cf9b-4976-b957-a7667ccdd31d"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:48.417244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d3a17c31-cd0f-4048-8ff1-0cef4a2e23d2 req-0e143534-ca9c-42c9-89be-6ab075cb15cf service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:48.417716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d3a17c31-cd0f-4048-8ff1-0cef4a2e23d2 req-0e143534-ca9c-42c9-89be-6ab075cb15cf service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:48.418357 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-d3a17c31-cd0f-4048-8ff1-0cef4a2e23d2 req-0e143534-ca9c-42c9-89be-6ab075cb15cf service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:48.430716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-d3a17c31-cd0f-4048-8ff1-0cef4a2e23d2 req-0e143534-ca9c-42c9-89be-6ab075cb15cf service nova] Creating event network-changed:867f9c8e-cf9b-4976-b957-a7667ccdd31d for instance 250c1856-e84e-4823-975c-af13f060c627 on hv-cinder-81574 Aug 30 01:04:48.436218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-d3a17c31-cd0f-4048-8ff1-0cef4a2e23d2 req-0e143534-ca9c-42c9-89be-6ab075cb15cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034808 Aug 30 01:04:48.437067 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 469/943] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:48.579375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:48.579978 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:48.586581 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:48.587208 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:48.587647 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:48.588324 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:48.588768 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:48.589317 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:48.800267 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:48.808342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fda91216-291e-4794-8e0a-9b708b43d03e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1367 microversion: 2.1 time: 0.233250 Aug 30 01:04:48.809567 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 475/944] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:48 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:49.233841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:49.234509 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:49.241792 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:49.242268 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:49.242693 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:49.243432 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:49.243870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:49.244283 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:49.386310 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:49.395561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-26451a71-525b-4391-b33c-a2f31fd25319 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.165431 Aug 30 01:04:49.395561 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 470/945] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:49 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:49.833755 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:49.834475 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:49.841370 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:49.842024 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:49.842497 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:49.843423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:49.843866 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:49.844277 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:50.050248 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:50.058508 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-bc2afd48-7a20-461c-a7dd-b09cc8e28ed7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1367 microversion: 2.1 time: 0.228635 Aug 30 01:04:50.059553 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 476/946] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:49 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:50.420593 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:50.420993 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:50.427822 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:50.428300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:50.428730 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:50.429417 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:50.429859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:50.430270 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:50.590247 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:50.598089 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-06602508-08ba-4a65-b8c7-df4ba644311b tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.185016 Aug 30 01:04:50.598654 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 471/947] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:50 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:51.012790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-c483b9de-fd42-4fd2-bd23-f36633eddb7d req-5f8b9642-2973-4c15-8e67-777fb9defbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e56311d-801a-4a0d-bf3d-92f1fb67631e", "name": "network-vif-plugged", "status": "completed", "tag": "357c4443-3206-42f6-8545-ce0a1c38efe6"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:51.025155 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-c483b9de-fd42-4fd2-bd23-f36633eddb7d req-5f8b9642-2973-4c15-8e67-777fb9defbc5 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:51.025627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-c483b9de-fd42-4fd2-bd23-f36633eddb7d req-5f8b9642-2973-4c15-8e67-777fb9defbc5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:51.026224 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-c483b9de-fd42-4fd2-bd23-f36633eddb7d req-5f8b9642-2973-4c15-8e67-777fb9defbc5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:51.038294 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-c483b9de-fd42-4fd2-bd23-f36633eddb7d req-5f8b9642-2973-4c15-8e67-777fb9defbc5 service nova] Creating event network-vif-plugged:357c4443-3206-42f6-8545-ce0a1c38efe6 for instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e on hv-cinder-81574 Aug 30 01:04:51.043313 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-c483b9de-fd42-4fd2-bd23-f36633eddb7d req-5f8b9642-2973-4c15-8e67-777fb9defbc5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 Aug 30 01:04:51.043904 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 477/948] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:51.081931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:51.082535 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:51.088671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:51.089152 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:51.089578 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:51.090367 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:51.090741 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:51.091185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:51.248681 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:51.257367 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8f209dd2-bd73-4c80-a52b-73bef4d38149 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1367 microversion: 2.1 time: 0.180328 Aug 30 01:04:51.257961 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 472/949] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:51 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:51.625001 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:51.625722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:51.632423 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:51.632866 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:51.633327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:51.634013 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:51.634463 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:51.634864 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:51.774721 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:51.778331 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=100 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:51.783516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-2527d9f0-ea8c-40a0-a0ea-d2629442caf1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1265 microversion: 2.1 time: 0.164115 Aug 30 01:04:51.784093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 478/950] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:51 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:52.281309 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:52.281933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:52.288867 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:52.289353 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:52.289776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:52.290464 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:52.290910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:52.291364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:52.437395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:52.445147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e79e693d-d6ea-4ba1-915d-6ade4592bcf8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1367 microversion: 2.1 time: 0.168943 Aug 30 01:04:52.445706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 473/951] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:52 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:52.804011 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:52.804709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:52.812512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:52.812995 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:52.813426 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:52.814128 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:52.814574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:52.814998 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:52.950466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:52.959070 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-86c61d1f-e913-46be-9b2f-e523f31aed08 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1453 microversion: 2.1 time: 0.159094 Aug 30 01:04:52.959659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 479/952] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:52 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:52.979926 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:52.980679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:52.987451 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:52.988035 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:52.988542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:52.989312 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:52.989840 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:52.990336 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.137208 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:53.145516 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c9bc955d-c097-415d-ad27-e8ff67756e11 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1453 microversion: 2.1 time: 0.169502 Aug 30 01:04:53.146022 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 474/953] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:52 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:53.465588 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:53.466300 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:53.472774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.473324 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.473899 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.474646 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:53.475170 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:53.475583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:53.692926 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:53.702406 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-50509398-f1be-4cfa-9a76-752311247bd1 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1367 microversion: 2.1 time: 0.240479 Aug 30 01:04:53.703046 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 480/954] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:53 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:54.723306 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:54.723893 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:54.730599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:54.731119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:54.731599 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:54.732311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:54.732792 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:54.733216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:55.018579 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:55.022634 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-77b828f0-1a4f-4a92-bb44-5226f58f2997 req-8e28e533-5966-42cb-85b4-89dbb8520026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250c1856-e84e-4823-975c-af13f060c627", "name": "network-vif-plugged", "status": "completed", "tag": "867f9c8e-cf9b-4976-b957-a7667ccdd31d"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:55.028957 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-763c3e37-5bd9-41f1-b353-c2eed0b9787d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1367 microversion: 2.1 time: 0.309554 Aug 30 01:04:55.042980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-77b828f0-1a4f-4a92-bb44-5226f58f2997 req-8e28e533-5966-42cb-85b4-89dbb8520026 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:55.042980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-77b828f0-1a4f-4a92-bb44-5226f58f2997 req-8e28e533-5966-42cb-85b4-89dbb8520026 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:55.042980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-77b828f0-1a4f-4a92-bb44-5226f58f2997 req-8e28e533-5966-42cb-85b4-89dbb8520026 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:55.044764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 475/955] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:54 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:55.053680 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-77b828f0-1a4f-4a92-bb44-5226f58f2997 req-8e28e533-5966-42cb-85b4-89dbb8520026 service nova] Creating event network-vif-plugged:867f9c8e-cf9b-4976-b957-a7667ccdd31d for instance 250c1856-e84e-4823-975c-af13f060c627 on hv-cinder-81574 Aug 30 01:04:55.059198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-77b828f0-1a4f-4a92-bb44-5226f58f2997 req-8e28e533-5966-42cb-85b4-89dbb8520026 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041211 Aug 30 01:04:55.060208 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 481/956] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:55.502952 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-86884c9b-62d4-4b33-8b3a-dab866a08245 req-fa35996f-001d-49d7-8ef4-6fa86e94927e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e56311d-801a-4a0d-bf3d-92f1fb67631e", "tag": "357c4443-3206-42f6-8545-ce0a1c38efe6"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:55.507861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=8 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:55.513918 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-86884c9b-62d4-4b33-8b3a-dab866a08245 req-fa35996f-001d-49d7-8ef4-6fa86e94927e service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:55.514471 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-86884c9b-62d4-4b33-8b3a-dab866a08245 req-fa35996f-001d-49d7-8ef4-6fa86e94927e service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:55.514897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-86884c9b-62d4-4b33-8b3a-dab866a08245 req-fa35996f-001d-49d7-8ef4-6fa86e94927e service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:55.529651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-86884c9b-62d4-4b33-8b3a-dab866a08245 req-fa35996f-001d-49d7-8ef4-6fa86e94927e service nova] Creating event network-changed:357c4443-3206-42f6-8545-ce0a1c38efe6 for instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e on hv-cinder-81574 Aug 30 01:04:55.534837 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-86884c9b-62d4-4b33-8b3a-dab866a08245 req-fa35996f-001d-49d7-8ef4-6fa86e94927e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035608 Aug 30 01:04:55.535655 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 476/957] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:56.051201 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:56.051896 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:56.056681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:56.058033 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=12 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:04:56.068160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:56.068646 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:56.069070 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:56.069764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:56.070453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:56.070819 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:56.289189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:56.299021 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c1ee8ef0-8000-424b-aaa3-b4a57afed521 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1367 microversion: 2.1 time: 0.252293 Aug 30 01:04:56.299659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 482/958] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:56 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:57.327455 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:57.328247 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:57.335307 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:57.335782 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:57.336207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:57.336900 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:57.337346 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:57.337763 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:57.471453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:04:57.481588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d4c23393-4adc-41d0-97d3-64440db60339 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1558 microversion: 2.1 time: 0.162242 Aug 30 01:04:57.482803 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 477/959] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:04:57 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:04:57.504661 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:04:57.505633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:04:57.513623 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:57.515174 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:57.515806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:57.516663 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:57.517769 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:57.518193 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:57.605823 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-7e47d401-c1c7-45ad-93f4-870cd60d98e4 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106842 Aug 30 01:04:57.606429 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 483/960] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 30 01:04:57 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:04:58.587460 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-b86b7229-bdff-43e4-915f-d56aa8d8634e req-5fa7fa7d-bf6e-42a7-aade-8213cee70729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250c1856-e84e-4823-975c-af13f060c627", "tag": "867f9c8e-cf9b-4976-b957-a7667ccdd31d"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:04:58.597845 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b86b7229-bdff-43e4-915f-d56aa8d8634e req-5fa7fa7d-bf6e-42a7-aade-8213cee70729 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:04:58.598310 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b86b7229-bdff-43e4-915f-d56aa8d8634e req-5fa7fa7d-bf6e-42a7-aade-8213cee70729 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:04:58.598731 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b86b7229-bdff-43e4-915f-d56aa8d8634e req-5fa7fa7d-bf6e-42a7-aade-8213cee70729 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:04:58.610207 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-b86b7229-bdff-43e4-915f-d56aa8d8634e req-5fa7fa7d-bf6e-42a7-aade-8213cee70729 service nova] Creating event network-changed:867f9c8e-cf9b-4976-b957-a7667ccdd31d for instance 250c1856-e84e-4823-975c-af13f060c627 on hv-cinder-81574 Aug 30 01:04:58.615258 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-b86b7229-bdff-43e4-915f-d56aa8d8634e req-5fa7fa7d-bf6e-42a7-aade-8213cee70729 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031451 Aug 30 01:04:58.615836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 478/961] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:34.987889 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:34.988728 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=24 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:34.994841 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:34.995936 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:35.004125 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:35.004638 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:35.005102 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:35.005904 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:35.006416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:35.006915 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:35.038651 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a3b6e304-6ac1-4049-a546-3672f88122a8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/ips" status: 200 len: 151 microversion: 2.1 time: 0.052816 Aug 30 01:05:35.039253 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 484/962] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 01:05:34 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:36.392237 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:36.393065 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=62 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:05:36.397430 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "232ed2d5-ae34-4834-b1a0-248246ff47f7"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:36.399914 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:36.407577 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:36.407997 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:36.408424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:36.409164 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:36.409611 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:36.410029 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:36.677555 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f9e9b7c1-31c6-4a1f-b3f3-9af83c59289e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286866 Aug 30 01:05:36.678166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 479/963] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:05:36 2022] POST /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:43.212720 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "232ed2d5-ae34-4834-b1a0-248246ff47f7"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:43.215122 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:43.222376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:43.222852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:43.223299 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:43.224037 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:43.224485 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:43.224903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:43.471518 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Invalid volume: volume 232ed2d5-ae34-4834-b1a0-248246ff47f7 is already attached to instances: 250c1856-e84e-4823-975c-af13f060c627 Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: POST /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments HTTP/1.1 Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 74 Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:05:43.474247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {"volumeAttachment": {"volumeId": "232ed2d5-ae34-4834-b1a0-248246ff47f7"}} Aug 30 01:05:43.476614 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Invalid volume: volume 232ed2d5-ae34-4834-b1a0-248246ff47f7 is already attached to instances: 250c1856-e84e-4823-975c-af13f060c627 Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'server_id': '250c1856-e84e-4823-975c-af13f060c627', 'body': {'volumeAttachment': {'volumeId': '232ed2d5-ae34-4834-b1a0-248246ff47f7'}}} Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 232ed2d5-ae34-4834-b1a0-248246ff47f7 is already attached to instances: 250c1856-e84e-4823-975c-af13f060c627 Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:05:43.477729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 232ed2d5-ae34-4834-b1a0-248246ff47f7 is already attached to instances: 250c1856-e84e-4823-975c-af13f060c627 Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:43.479868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:05:43.482163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:05:43.482163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:05:43.482163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:05:43.482163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 232ed2d5-ae34-4834-b1a0-248246ff47f7 is already attached to instances: 250c1856-e84e-4823-975c-af13f060c627 Aug 30 01:05:43.482163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:05:43.482163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 400 to user: Invalid volume: volume 232ed2d5-ae34-4834-b1a0-248246ff47f7 is already attached to instances: 250c1856-e84e-4823-975c-af13f060c627 {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:05:43.482163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fae316bb-b953-449b-b002-7e44260ebde8 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.267604 Aug 30 01:05:43.482163 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 485/964] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:05:43 2022] POST /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments => generated 174 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 01:05:43.551526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:43.552109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:43.558789 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:43.559296 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:43.560087 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:43.560773 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:43.561222 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:43.561639 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:43.703328 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lazy-loading 'services' on Instance uuid 250c1856-e84e-4823-975c-af13f060c627 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:05:43.793883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0541f340-2f3c-40ba-adcf-4ddd3aed8ec0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments/232ed2d5-ae34-4834-b1a0-248246ff47f7" status: 202 len: 0 microversion: 2.1 time: 0.246642 Aug 30 01:05:43.794855 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 480/965] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:05:43 2022] DELETE /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments/232ed2d5-ae34-4834-b1a0-248246ff47f7 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:05:43.804981 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:43.807280 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:43.813826 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:43.814321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:43.814729 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:43.815466 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:43.815954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:43.816333 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:43.849969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-0da84671-ee3f-48bd-9ea5-f8d687e5f7e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049309 Aug 30 01:05:43.850840 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 486/966] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:05:43 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:05:44.864856 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:44.867488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:44.875611 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.876134 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.876608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.877369 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.877862 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.878321 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.911789 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-f9c0f901-d787-4314-8a68-45502c83395d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052553 Aug 30 01:05:44.912380 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 481/967] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:05:44 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:05:44.977042 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:44.977630 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:44.984605 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.985087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.985519 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:44.986215 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:44.986663 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:44.987118 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:45.012772 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:05:45.103478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-037a6c10-c283-43fe-a88f-847a14a66e31 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 204 len: 0 microversion: 2.1 time: 0.130037 Aug 30 01:05:45.104072 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 487/968] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:05:44 2022] DELETE /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:05:45.112843 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:45.113435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:45.119834 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:45.120233 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:45.120661 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:45.121396 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:45.121836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:45.122234 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:45.274011 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:45.283466 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e1a7c7fc-9104-4df4-9136-e847b82b9cc9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1683 microversion: 2.1 time: 0.174489 Aug 30 01:05:45.284109 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 482/969] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:45 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:46.313318 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:46.314455 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:46.324586 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:46.325382 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:46.326198 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:46.326893 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:46.327368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:46.327815 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:46.468688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:46.476888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b5029d20-4c84-48dd-9635-933fa8f4f01d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1683 microversion: 2.1 time: 0.171770 Aug 30 01:05:46.477455 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 488/970] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:46 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:47.498467 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:47.499148 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:47.506480 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:47.507095 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:47.507524 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:47.508225 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:47.508670 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:47.509081 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:47.688884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:47.697572 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5dee6c5b-0cbd-41a1-8a04-3c9e451da249 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 200 len: 1616 microversion: 2.1 time: 0.203087 Aug 30 01:05:47.705544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 483/971] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:47 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 1616 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:47.929622 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-17ca4b9e-0c03-4bbd-a6f0-fb524ccd92c6 req-19ddfeb4-0421-4117-a656-33ce6a66c25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250c1856-e84e-4823-975c-af13f060c627", "name": "network-vif-deleted", "tag": "867f9c8e-cf9b-4976-b957-a7667ccdd31d"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:47.940398 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-17ca4b9e-0c03-4bbd-a6f0-fb524ccd92c6 req-19ddfeb4-0421-4117-a656-33ce6a66c25b service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:47.941039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-17ca4b9e-0c03-4bbd-a6f0-fb524ccd92c6 req-19ddfeb4-0421-4117-a656-33ce6a66c25b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:47.941492 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-17ca4b9e-0c03-4bbd-a6f0-fb524ccd92c6 req-19ddfeb4-0421-4117-a656-33ce6a66c25b service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:47.953416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-17ca4b9e-0c03-4bbd-a6f0-fb524ccd92c6 req-19ddfeb4-0421-4117-a656-33ce6a66c25b service nova] Creating event network-vif-deleted:867f9c8e-cf9b-4976-b957-a7667ccdd31d for instance 250c1856-e84e-4823-975c-af13f060c627 on hv-cinder-81574 Aug 30 01:05:47.958732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-17ca4b9e-0c03-4bbd-a6f0-fb524ccd92c6 req-19ddfeb4-0421-4117-a656-33ce6a66c25b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032862 Aug 30 01:05:47.959580 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 489/972] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:48.724324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:48.724957 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:48.732216 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:48.732804 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:48.733217 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:48.733939 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:48.734403 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:48.735018 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:48.750825 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 HTTP/1.1 Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:05:48.752544 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:05:48.754190 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '250c1856-e84e-4823-975c-af13f060c627'} Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:05:48.755538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:05:48.756830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:05:48.758888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:05:48.758888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c5aa351e-a570-4280-9cf4-5df74f0b2c16 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 404 len: 111 microversion: 2.1 time: 0.033645 Aug 30 01:05:48.758888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 484/973] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:48 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:05:48.763712 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-26fa3301-5d09-461c-a83d-7623b1eb5271 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '.version_select at 0x7f03a1edfb80>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:48.785692 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-26fa3301-5d09-461c-a83d-7623b1eb5271 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358519481" status: 202 len: 0 microversion: 2.1 time: 0.026164 Aug 30 01:05:48.786285 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 490/974] 10.222.0.17 () {58 vars in 1221 bytes} [Tue Aug 30 01:05:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358519481 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:05:49.422870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5a73ac37-5101-45bb-93b8-faa5af8b70cb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: .version_select at 0x7f03a1e759d0>, body: {"keypair": {"name": "tempest-keypair-605754875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXAheyvecTizvcaV9fVvQHjtG1p74VvQbR3/nSyeEwc6obki02bX7MWdyoIGkid2iwBMYTchWNcyMvyYTZN7ER4bsorBUeQrS1D2sw/HZKsTe0XoIztE9/BNvXlVTS7Pw=="}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:49.439536 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-5a73ac37-5101-45bb-93b8-faa5af8b70cb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for project fe19812dff73433b8b29d24ddbea3f56. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:05:49.443737 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-5a73ac37-5101-45bb-93b8-faa5af8b70cb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for user 9d7babb2d721414496d45840f9253852 and project fe19812dff73433b8b29d24ddbea3f56. Resources: {'key_pairs'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:05:49.469437 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5a73ac37-5101-45bb-93b8-faa5af8b70cb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050988 Aug 30 01:05:49.470032 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 485/975] 10.222.0.17 () {60 vars in 1159 bytes} [Tue Aug 30 01:05:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:50.790224 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1377336621", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89b78a04-c7c4-429f-b8b3-b10b127267cb"}], "security_groups": [{"name": "tempest-securitygroup--1607457226"}], "key_name": "tempest-keypair-605754875", "user_data": "}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:50.909468 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] validate_networks() for [('89b78a04-c7c4-429f-b8b3-b10b127267cb', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:05:51.297233 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:05:51.297647 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:05:51.298116 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:05:51.298516 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:05:51.298921 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:05:51.308082 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:51.308558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:51.309021 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:51.309743 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:51.310548 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:51.310964 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:51.328123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for project fe19812dff73433b8b29d24ddbea3f56. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:05:51.332254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Getting quotas for user 9d7babb2d721414496d45840f9253852 and project fe19812dff73433b8b29d24ddbea3f56. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:05:51.343387 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:05:51.345789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:05:51.394879 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c3fe83e5-c1c2-4c37-8458-bbf104fbcd18 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609455 Aug 30 01:05:51.399226 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 491/976] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:05:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:05:51.407300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-1e50e293-0217-4e26-a14e-c243d64e344d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:51.408003 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-1e50e293-0217-4e26-a14e-c243d64e344d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:51.466756 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-1e50e293-0217-4e26-a14e-c243d64e344d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:51.474967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-1e50e293-0217-4e26-a14e-c243d64e344d tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1241 microversion: 2.1 time: 0.072310 Aug 30 01:05:51.475597 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 486/977] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:51 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:52.496524 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:52.497140 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:52.505627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:52.506211 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:52.506617 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:52.507566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:52.508015 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:52.508436 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:52.584520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:52.592320 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-632a67a6-ba74-45a6-85b7-56d8420e3bed tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1301 microversion: 2.1 time: 0.100427 Aug 30 01:05:52.592873 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 492/978] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:52 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:53.613511 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:53.614145 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:53.620411 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:53.620888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:53.621308 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:53.621998 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:53.622442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:53.622856 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:53.836431 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:53.847374 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cb668655-b779-46be-ad23-062f4acb26e7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1367 microversion: 2.1 time: 0.238260 Aug 30 01:05:53.848371 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 487/979] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:53 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:54.015254 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-0d35b6fa-946c-4c8a-a61c-4a9520c7a9f4 req-1e724e43-ec0c-435f-984c-8f4531faeaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6ea9bc-f519-45e0-9377-c10c41acea0e", "tag": "5255dd62-ea75-4f5b-bf24-22ddfaeb7094"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:54.035526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0d35b6fa-946c-4c8a-a61c-4a9520c7a9f4 req-1e724e43-ec0c-435f-984c-8f4531faeaa7 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:54.036001 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0d35b6fa-946c-4c8a-a61c-4a9520c7a9f4 req-1e724e43-ec0c-435f-984c-8f4531faeaa7 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:54.036429 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0d35b6fa-946c-4c8a-a61c-4a9520c7a9f4 req-1e724e43-ec0c-435f-984c-8f4531faeaa7 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:54.053380 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-0d35b6fa-946c-4c8a-a61c-4a9520c7a9f4 req-1e724e43-ec0c-435f-984c-8f4531faeaa7 service nova] Creating event network-changed:5255dd62-ea75-4f5b-bf24-22ddfaeb7094 for instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e on hv-cinder-81574 Aug 30 01:05:54.058848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-0d35b6fa-946c-4c8a-a61c-4a9520c7a9f4 req-1e724e43-ec0c-435f-984c-8f4531faeaa7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048332 Aug 30 01:05:54.059912 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 493/980] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:54.873536 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:54.874566 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:54.881607 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:54.882081 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:54.882503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:54.883223 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:54.883673 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:54.884097 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:55.020955 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:55.028899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-18a0eacc-c4c3-4b1c-b8ac-6e133c61deaf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1367 microversion: 2.1 time: 0.161932 Aug 30 01:05:55.029466 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 488/981] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:54 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:56.051149 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:56.051845 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:56.058138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:56.058617 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:56.059137 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:56.059832 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:56.060642 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:56.061061 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:56.481800 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:56.490371 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9137ca69-4c89-4d9e-b1f6-1efdac438816 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1367 microversion: 2.1 time: 0.444320 Aug 30 01:05:56.490951 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 494/982] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:56 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:57.510651 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:57.511288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:57.517899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:57.518442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:57.518901 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:57.519626 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:57.520066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:57.520481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:57.653126 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:57.661875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-c2ede06d-84a6-417c-b05e-70ead1f2a1cf tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1367 microversion: 2.1 time: 0.155153 Aug 30 01:05:57.662445 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 489/983] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:57 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:58.686359 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:58.687277 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:58.694266 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:58.694743 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:58.695210 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:58.695901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:58.696346 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:58.696764 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:58.829744 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:05:58.838063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-18d7357e-fe7f-440d-8803-2846fce0b09a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1367 microversion: 2.1 time: 0.157460 Aug 30 01:05:58.838633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 495/984] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:58 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:05:59.455266 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-fb9fd294-e857-4419-8dd9-dbc437e1a54e req-d0ae61db-be31-4671-b621-8fed95707ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6ea9bc-f519-45e0-9377-c10c41acea0e", "name": "network-vif-plugged", "status": "completed", "tag": "5255dd62-ea75-4f5b-bf24-22ddfaeb7094"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:05:59.466945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-fb9fd294-e857-4419-8dd9-dbc437e1a54e req-d0ae61db-be31-4671-b621-8fed95707ac0 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:59.467519 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-fb9fd294-e857-4419-8dd9-dbc437e1a54e req-d0ae61db-be31-4671-b621-8fed95707ac0 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:59.468185 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-fb9fd294-e857-4419-8dd9-dbc437e1a54e req-d0ae61db-be31-4671-b621-8fed95707ac0 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:59.479907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-fb9fd294-e857-4419-8dd9-dbc437e1a54e req-d0ae61db-be31-4671-b621-8fed95707ac0 service nova] Creating event network-vif-plugged:5255dd62-ea75-4f5b-bf24-22ddfaeb7094 for instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e on hv-cinder-81574 Aug 30 01:05:59.485294 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-fb9fd294-e857-4419-8dd9-dbc437e1a54e req-d0ae61db-be31-4671-b621-8fed95707ac0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034104 Aug 30 01:05:59.485908 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 490/985] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:05:59.858897 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:05:59.859624 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:05:59.866522 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:59.866998 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:59.867539 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:05:59.868216 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:05:59.868666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:05:59.869088 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:00.002973 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:00.011063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1d0309ca-73a7-42e9-b457-4ec6d54beca7 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1367 microversion: 2.1 time: 0.156148 Aug 30 01:06:00.011644 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 496/986] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:05:59 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:01.035137 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:01.035808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:01.042947 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:01.043711 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:01.044377 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:01.045096 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:01.045622 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:01.046089 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:01.195102 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:01.203052 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-159096a2-f4af-44f5-bf15-f8ea0924590a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1367 microversion: 2.1 time: 0.174103 Aug 30 01:06:01.203630 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 491/987] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:01 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:02.226246 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:02.227140 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:02.230448 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:02.231414 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:02.238374 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:02.238849 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:02.239306 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:02.240057 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:02.240509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:02.240925 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:02.383317 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:02.394177 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-fbe9161e-9916-4a27-89fb-93b0e5f2680c tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1558 microversion: 2.1 time: 0.173554 Aug 30 01:06:02.394730 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 497/988] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:02 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:02.421051 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:02.421831 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:02.424234 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:02.433045 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:02.433654 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:02.434268 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:02.435770 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:02.436402 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:02.437025 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:02.529157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-cc2149ff-c39f-4430-aafe-bcddeb101d12 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114482 Aug 30 01:06:02.529753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 492/989] 10.222.0.17 () {58 vars in 1275 bytes} [Tue Aug 30 01:06:02 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:03.519323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-0690930d-1421-4a27-8e1d-9ff233ac7656 req-a42c641e-7526-4452-85e1-e10dbca8e7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f6ea9bc-f519-45e0-9377-c10c41acea0e", "tag": "5255dd62-ea75-4f5b-bf24-22ddfaeb7094"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:03.529530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0690930d-1421-4a27-8e1d-9ff233ac7656 req-a42c641e-7526-4452-85e1-e10dbca8e7d5 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:03.530006 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0690930d-1421-4a27-8e1d-9ff233ac7656 req-a42c641e-7526-4452-85e1-e10dbca8e7d5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:03.530447 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-0690930d-1421-4a27-8e1d-9ff233ac7656 req-a42c641e-7526-4452-85e1-e10dbca8e7d5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:03.541872 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-0690930d-1421-4a27-8e1d-9ff233ac7656 req-a42c641e-7526-4452-85e1-e10dbca8e7d5 service nova] Creating event network-changed:5255dd62-ea75-4f5b-bf24-22ddfaeb7094 for instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e on hv-cinder-81574 Aug 30 01:06:03.547136 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-0690930d-1421-4a27-8e1d-9ff233ac7656 req-a42c641e-7526-4452-85e1-e10dbca8e7d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031847 Aug 30 01:06:03.547785 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 498/990] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:35.251683 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:35.252376 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:35.252748 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:35.252852 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:35.257415 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-2ca67b00-f8bd-4370-859a-b2df7b5b5f2c req-1d2ea4a2-cfb9-434f-9d2a-1bccabac9357 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e56311d-801a-4a0d-bf3d-92f1fb67631e", "tag": "357c4443-3206-42f6-8545-ce0a1c38efe6"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:35.257607 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:35.258316 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:35.264113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.264604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.265092 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.266215 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.266335 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.266851 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.269868 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-2ca67b00-f8bd-4370-859a-b2df7b5b5f2c req-1d2ea4a2-cfb9-434f-9d2a-1bccabac9357 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.270319 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-2ca67b00-f8bd-4370-859a-b2df7b5b5f2c req-1d2ea4a2-cfb9-434f-9d2a-1bccabac9357 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.270735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-2ca67b00-f8bd-4370-859a-b2df7b5b5f2c req-1d2ea4a2-cfb9-434f-9d2a-1bccabac9357 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.282714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-2ca67b00-f8bd-4370-859a-b2df7b5b5f2c req-1d2ea4a2-cfb9-434f-9d2a-1bccabac9357 service nova] Creating event network-changed:357c4443-3206-42f6-8545-ce0a1c38efe6 for instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e on hv-cinder-81574 Aug 30 01:06:35.288391 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-2ca67b00-f8bd-4370-859a-b2df7b5b5f2c req-1d2ea4a2-cfb9-434f-9d2a-1bccabac9357 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038458 Aug 30 01:06:35.289223 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 499/991] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:35.302183 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:35.398427 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b27a8d46-262d-486a-9956-6c3768ca5740 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 204 len: 0 microversion: 2.1 time: 0.150476 Aug 30 01:06:35.399424 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 493/992] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:35 2022] DELETE /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:35.408115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:35.408918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:35.416780 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.416780 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.417182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.417901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.418417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.418901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.467711 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:35.468293 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:35.477607 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.478097 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.479450 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.480192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:35.480652 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:35.481079 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:35.507320 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0a68151d-fa1b-4275-9250-230cd190c227 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/ips" status: 200 len: 151 microversion: 2.1 time: 0.044760 Aug 30 01:06:35.508191 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 494/993] 10.222.0.17 () {58 vars in 1248 bytes} [Tue Aug 30 01:06:35 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:06:35.591243 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:35.599664 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1c86e6ff-4963-45d5-a3dd-963d3eb0342f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1577 microversion: 2.1 time: 0.195823 Aug 30 01:06:35.600255 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 500/994] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:35 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:36.623031 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:36.623662 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:36.630469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:36.630950 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:36.631397 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:36.632075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:36.632502 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:36.632912 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:36.807395 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:36.816339 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d846798a-70ea-439f-9e8a-264b426f0384 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1577 microversion: 2.1 time: 0.197860 Aug 30 01:06:36.816893 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 495/995] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:36 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:36.869442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22f6e9e3-0437-4775-b443-bff12771fa80"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:36.871888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:36.878501 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:36.878882 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:36.879321 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:36.880032 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:36.880488 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:36.880895 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.220033 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-971a1513-a49d-4c9d-9964-9a22fa6c4ae0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "POST /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354554 Aug 30 01:06:37.223029 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 501/996] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:06:36 2022] POST /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:37.629222 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-ba966fa3-f756-4d92-ac38-e34d2040ce83 req-864822a3-52cd-4fea-a9cb-886e26a3d972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e56311d-801a-4a0d-bf3d-92f1fb67631e", "name": "network-vif-deleted", "tag": "357c4443-3206-42f6-8545-ce0a1c38efe6"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:37.641770 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ba966fa3-f756-4d92-ac38-e34d2040ce83 req-864822a3-52cd-4fea-a9cb-886e26a3d972 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.642443 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ba966fa3-f756-4d92-ac38-e34d2040ce83 req-864822a3-52cd-4fea-a9cb-886e26a3d972 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.642888 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-ba966fa3-f756-4d92-ac38-e34d2040ce83 req-864822a3-52cd-4fea-a9cb-886e26a3d972 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.655959 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-ba966fa3-f756-4d92-ac38-e34d2040ce83 req-864822a3-52cd-4fea-a9cb-886e26a3d972 service nova] Creating event network-vif-deleted:357c4443-3206-42f6-8545-ce0a1c38efe6 for instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e on hv-cinder-81574 Aug 30 01:06:37.662588 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-ba966fa3-f756-4d92-ac38-e34d2040ce83 req-864822a3-52cd-4fea-a9cb-886e26a3d972 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037009 Aug 30 01:06:37.666338 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 496/997] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:37.841523 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:37.842212 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:37.848980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.849460 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.849890 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:37.850584 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:37.851036 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:37.851468 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:38.199386 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:38.207973 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4ccf993a-747b-4a58-a473-1571e61f03f0 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 200 len: 1224 microversion: 2.1 time: 0.371320 Aug 30 01:06:38.208538 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 502/998] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:37 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 1224 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:39.231841 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:39.232671 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 0e56311d-801a-4a0d-bf3d-92f1fb67631e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:39.240945 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:39.241518 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:39.242036 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:39.242870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:39.243451 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:39.243979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:39.257903 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] HTTP exception thrown: Instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e could not be found. Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Request method failure captured: Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e HTTP/1.1 Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWDBEN2kSBKcT1OLI8a2onvcxE4aLrugi-4jO7a-aHTBqhMKy3InvG2wLWGgNzRqyba05XI5s9JQTyu9Y41behMfj_X0JI7BfSR5hjFhC8ckXcSS4TqIE1LbszPE6gna_PSQ0EY8dJhFagoSoqpe7X0DMIPn-z3M2czJFi4bC7x-VTE Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:06:39.259589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4baca9d3a3e45d883482957e9ce8cb0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}] Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 455284c947254207a719459efc031bea Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e could not be found. Aug 30 01:06:39.261334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '0e56311d-801a-4a0d-bf3d-92f1fb67631e'} Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e could not be found. Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:39.262497 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e could not be found. Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e could not be found. Aug 30 01:06:39.264576 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:39.266567 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Returning 404 to user: Instance 0e56311d-801a-4a0d-bf3d-92f1fb67631e could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:39.266567 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-4727772b-ceec-446e-9bf4-f97a64aab1de tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e" status: 404 len: 111 microversion: 2.1 time: 0.034775 Aug 30 01:06:39.266567 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 497/999] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:39 2022] GET /compute/v2.1/servers/0e56311d-801a-4a0d-bf3d-92f1fb67631e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:42.411538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-a3429bc4-6a7c-4538-991d-da9d2e52a726 req-f4bde73d-718a-4f28-916c-7e08aa55c069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ceda193-ffbd-453f-abf9-760cc5b4e6cd", "tag": "bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:42.418711 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:42.419226 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:42.425967 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.426795 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.427435 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.428178 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.428606 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.429060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.430892 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a3429bc4-6a7c-4538-991d-da9d2e52a726 req-f4bde73d-718a-4f28-916c-7e08aa55c069 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.431409 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a3429bc4-6a7c-4538-991d-da9d2e52a726 req-f4bde73d-718a-4f28-916c-7e08aa55c069 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.431832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-a3429bc4-6a7c-4538-991d-da9d2e52a726 req-f4bde73d-718a-4f28-916c-7e08aa55c069 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.444227 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-a3429bc4-6a7c-4538-991d-da9d2e52a726 req-f4bde73d-718a-4f28-916c-7e08aa55c069 service nova] Creating event network-changed:bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d for instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd on hv-cinder-81574 Aug 30 01:06:42.449724 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-a3429bc4-6a7c-4538-991d-da9d2e52a726 req-f4bde73d-718a-4f28-916c-7e08aa55c069 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041878 Aug 30 01:06:42.450541 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 498/1000] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:42.458681 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:42.557293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9c5e8c91-5d01-4d73-99f5-6618f17d1a0e tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 204 len: 0 microversion: 2.1 time: 0.151835 Aug 30 01:06:42.562097 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 503/1001] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:42 2022] DELETE /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:42.567564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:42.568552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:42.575462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.576253 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.576866 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.578064 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:42.578692 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:42.579334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:42.730038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:42.737939 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e5cf9446-02b2-455a-a0be-01179eb0992c tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1577 microversion: 2.1 time: 0.174602 Aug 30 01:06:42.738533 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 499/1002] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:42 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:43.760695 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:43.761313 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:43.768134 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:43.768612 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:43.769045 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:43.769718 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:43.770169 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:43.770608 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:43.932966 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:43.941653 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-22d37b9f-0acb-4c46-b500-43baa7bea763 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1577 microversion: 2.1 time: 0.185483 Aug 30 01:06:43.942195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 504/1003] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:43 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:44.905681 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:44.906240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:44.912775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:44.913254 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:44.913677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:44.914361 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:44.914800 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:44.915240 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:44.963643 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:44.965096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:44.972247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:44.972732 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:44.973130 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:44.974010 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:44.975159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:44.975748 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:45.020788 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lazy-loading 'services' on Instance uuid 0f6ea9bc-f519-45e0-9377-c10c41acea0e {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:45.077680 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '455284c947254207a719459efc031bea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4baca9d3a3e45d883482957e9ce8cb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:45.085676 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-ddf09328-6bd5-4faf-9bb4-659c998006a6 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 200 len: 1391 microversion: 2.1 time: 0.125943 Aug 30 01:06:45.086251 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 505/1004] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:44 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 1391 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:45.104431 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-d3ebf8b8-cce5-4710-9dc0-1a45f9a0da57 req-47d77396-4871-4c2e-8ecf-ab14b7bbe5aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ceda193-ffbd-453f-abf9-760cc5b4e6cd", "name": "network-vif-deleted", "tag": "bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:45.114071 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d3ebf8b8-cce5-4710-9dc0-1a45f9a0da57 req-47d77396-4871-4c2e-8ecf-ab14b7bbe5aa service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:45.116072 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d3ebf8b8-cce5-4710-9dc0-1a45f9a0da57 req-47d77396-4871-4c2e-8ecf-ab14b7bbe5aa service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:45.116072 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-d3ebf8b8-cce5-4710-9dc0-1a45f9a0da57 req-47d77396-4871-4c2e-8ecf-ab14b7bbe5aa service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:45.129347 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-83e0b893-e65f-4e16-948d-8b75158b2964 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-volume_attachments/22f6e9e3-0437-4775-b443-bff12771fa80" status: 202 len: 0 microversion: 2.1 time: 0.227488 Aug 30 01:06:45.130625 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 500/1005] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:06:44 2022] DELETE /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-volume_attachments/22f6e9e3-0437-4775-b443-bff12771fa80 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:06:45.132041 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-d3ebf8b8-cce5-4710-9dc0-1a45f9a0da57 req-47d77396-4871-4c2e-8ecf-ab14b7bbe5aa service nova] Creating event network-vif-deleted:bbafc0a7-d1bb-4a45-9d88-9daf8ce19e1d for instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd on hv-cinder-81574 Aug 30 01:06:45.136988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-d3ebf8b8-cce5-4710-9dc0-1a45f9a0da57 req-47d77396-4871-4c2e-8ecf-ab14b7bbe5aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036030 Aug 30 01:06:45.137549 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 506/1006] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:45.139044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:45.141898 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:45.148682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:45.149160 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:45.149587 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:45.150280 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:45.150723 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:45.151166 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:45.181004 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-258076ca-905d-45ed-b210-559c9c028bfb tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046431 Aug 30 01:06:45.181525 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 501/1007] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:45 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 01:06:46.108784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:46.109506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9ceda193-ffbd-453f-abf9-760cc5b4e6cd] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:46.116843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.117342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.117792 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.118517 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.118989 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.119458 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.134239 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] HTTP exception thrown: Instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd could not be found. Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Request method failure captured: Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd HTTP/1.1 Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWDBEN2kSBKcT1OLI8a2onvcxE4aLrugi-4jO7a-aHTBqhMKy3InvG2wLWGgNzRqyba05XI5s9JQTyu9Y41behMfj_X0JI7BfSR5hjFhC8ckXcSS4TqIE1LbszPE6gna_PSQ0EY8dJhFagoSoqpe7X0DMIPn-z3M2czJFi4bC7x-VTE Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:06:46.135901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4baca9d3a3e45d883482957e9ce8cb0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}] Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 455284c947254207a719459efc031bea Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd could not be found. Aug 30 01:06:46.137328 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '9ceda193-ffbd-453f-abf9-760cc5b4e6cd'} Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd could not be found. Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:46.138123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd could not be found. Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd could not be found. Aug 30 01:06:46.139557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.140955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Returning 404 to user: Instance 9ceda193-ffbd-453f-abf9-760cc5b4e6cd could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:46.140955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-cbc4d6ed-f542-4bda-a391-f3431eb4a4b1 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd" status: 404 len: 111 microversion: 2.1 time: 0.033988 Aug 30 01:06:46.140955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 507/1008] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:46 2022] GET /compute/v2.1/servers/9ceda193-ffbd-453f-abf9-760cc5b4e6cd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:46.197346 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:46.199917 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:46.206764 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.207278 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.207706 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.208429 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.208877 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.209290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.241266 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8508bc26-0b7e-45af-92b8-bc5a55cd3697 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048147 Aug 30 01:06:46.242029 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 502/1009] 10.222.0.17 () {58 vars in 1302 bytes} [Tue Aug 30 01:06:46 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 01:06:46.306565 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:46.307074 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:46.313607 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.314080 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.314504 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.315302 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.315755 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.316336 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.341666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:06:46.423633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-43b2c5f4-6375-4e2d-aa84-a64263ab1aa2 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 204 len: 0 microversion: 2.1 time: 0.120604 Aug 30 01:06:46.424524 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 508/1010] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:46 2022] DELETE /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:06:46.433194 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:46.434005 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:46.440741 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.441300 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.441794 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.442552 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.443069 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.443575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.684252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:46.693334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-121ec0fd-555a-4242-b37e-789031298224 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1683 microversion: 2.1 time: 0.263854 Aug 30 01:06:46.694129 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 503/1011] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:46 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1683 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:46.702574 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:46.703189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:46.709572 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.710056 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.710490 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.711229 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.711684 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.712109 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.726372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] HTTP exception thrown: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Request method failure captured: Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: DELETE /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 HTTP/1.1 Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWDBEN2kSBKcT1OLI8a2onvcxE4aLrugi-4jO7a-aHTBqhMKy3InvG2wLWGgNzRqyba05XI5s9JQTyu9Y41behMfj_X0JI7BfSR5hjFhC8ckXcSS4TqIE1LbszPE6gna_PSQ0EY8dJhFagoSoqpe7X0DMIPn-z3M2czJFi4bC7x-VTE Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:06:46.728083 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4baca9d3a3e45d883482957e9ce8cb0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}] Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 455284c947254207a719459efc031bea Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.729774 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '9b7f85e9-692b-454e-95f3-5dc087400373'} Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:46.730953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.732688 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.734478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Returning 404 to user: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:46.734478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-61d80c58-5849-469d-ad7c-cce3695f4b26 tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 404 len: 111 microversion: 2.1 time: 0.032141 Aug 30 01:06:46.734478 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 509/1012] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:46 2022] DELETE /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:46.739944 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:46.740547 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] [instance: 9b7f85e9-692b-454e-95f3-5dc087400373] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:46.746956 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.747483 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.747911 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.748589 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:46.749062 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:46.749501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:46.762995 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] HTTP exception thrown: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Request method failure captured: Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 HTTP/1.1 Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWDBEN2kSBKcT1OLI8a2onvcxE4aLrugi-4jO7a-aHTBqhMKy3InvG2wLWGgNzRqyba05XI5s9JQTyu9Y41behMfj_X0JI7BfSR5hjFhC8ckXcSS4TqIE1LbszPE6gna_PSQ0EY8dJhFagoSoqpe7X0DMIPn-z3M2czJFi4bC7x-VTE Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:06:46.764638 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d4baca9d3a3e45d883482957e9ce8cb0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d4baca9d3a3e45d883482957e9ce8cb0"}]}] Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: d4baca9d3a3e45d883482957e9ce8cb0 Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1214980656 Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 455284c947254207a719459efc031bea Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-TestVolumeBootPattern-1214980656-project Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.766265 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '9b7f85e9-692b-454e-95f3-5dc087400373'} Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:46.767187 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. Aug 30 01:06:46.768669 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:46.769979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Returning 404 to user: Instance 9b7f85e9-692b-454e-95f3-5dc087400373 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:46.769979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-fe1ffb0f-96e4-4b53-8b35-ac71b221ac3f tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373" status: 404 len: 111 microversion: 2.1 time: 0.029947 Aug 30 01:06:46.769979 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 504/1013] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:46 2022] GET /compute/v2.1/servers/9b7f85e9-692b-454e-95f3-5dc087400373 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:47.718139 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:47.718751 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:47.725716 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.726228 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.726640 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.727363 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:47.727821 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:47.728235 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:47.865602 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:47.877373 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-a3bc9004-44b1-4b11-8270-86d0eee1b3d0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1683 microversion: 2.1 time: 0.163357 Aug 30 01:06:47.878207 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 510/1014] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:47 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:48.226898 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-75a5358d-0b32-43e6-ab33-e9fe0a9f6ffe tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] Calling method '.version_select at 0x7f03a1dc0040>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:48.251778 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-75a5358d-0b32-43e6-ab33-e9fe0a9f6ffe tempest-TestVolumeBootPattern-1214980656 tempest-TestVolumeBootPattern-1214980656-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-694307074" status: 202 len: 0 microversion: 2.1 time: 0.028982 Aug 30 01:06:48.252371 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 505/1015] 10.222.0.17 () {58 vars in 1260 bytes} [Tue Aug 30 01:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-694307074 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:06:48.900480 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:48.901115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:48.908356 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:48.908842 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:48.909272 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:48.909978 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:48.910425 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:48.910859 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:49.193914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:49.205589 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-86ad6856-8439-4ffe-b824-38bdb3334060 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1683 microversion: 2.1 time: 0.308971 Aug 30 01:06:49.206275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 511/1016] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:48 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1683 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:49.699171 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-b5c3eff3-77b7-4d8e-88b8-aae1d5fcf908 req-85711642-9f62-4ef8-b6da-842c4fd8a7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f6ea9bc-f519-45e0-9377-c10c41acea0e", "name": "network-vif-deleted", "tag": "5255dd62-ea75-4f5b-bf24-22ddfaeb7094"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:06:49.717842 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b5c3eff3-77b7-4d8e-88b8-aae1d5fcf908 req-85711642-9f62-4ef8-b6da-842c4fd8a7cd service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:49.718326 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b5c3eff3-77b7-4d8e-88b8-aae1d5fcf908 req-85711642-9f62-4ef8-b6da-842c4fd8a7cd service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:49.719370 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-b5c3eff3-77b7-4d8e-88b8-aae1d5fcf908 req-85711642-9f62-4ef8-b6da-842c4fd8a7cd service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:49.732304 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-b5c3eff3-77b7-4d8e-88b8-aae1d5fcf908 req-85711642-9f62-4ef8-b6da-842c4fd8a7cd service nova] Creating event network-vif-deleted:5255dd62-ea75-4f5b-bf24-22ddfaeb7094 for instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e on hv-cinder-81574 Aug 30 01:06:49.737974 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-b5c3eff3-77b7-4d8e-88b8-aae1d5fcf908 req-85711642-9f62-4ef8-b6da-842c4fd8a7cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043016 Aug 30 01:06:49.738748 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 506/1017] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:06:50.227763 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:50.229277 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:50.241625 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:50.256189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:50.256943 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:50.257982 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:50.260513 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:50.261196 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:50.311951 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:50.312709 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:50.313339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:50.314182 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lazy-loading 'fault' on Instance uuid 0f6ea9bc-f519-45e0-9377-c10c41acea0e {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:06:50.382195 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d7babb2d721414496d45840f9253852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe19812dff73433b8b29d24ddbea3f56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:06:50.390994 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-edb84602-99ea-446c-bc65-96b5645dd604 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 200 len: 1331 microversion: 2.1 time: 0.167055 Aug 30 01:06:50.392811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 512/1018] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:50 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 1331 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:06:51.414297 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:51.415415 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:51.421925 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:51.422701 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:51.423163 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:51.423829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:51.424469 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:51.424852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:51.439758 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e HTTP/1.1 Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:06:51.441438 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:51.442907 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '0f6ea9bc-f519-45e0-9377-c10c41acea0e'} Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:51.443750 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:51.445009 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:51.446605 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:51.446605 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-28d30035-c91c-4406-b4cb-90f847d213cc tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 404 len: 111 microversion: 2.1 time: 0.033437 Aug 30 01:06:51.446605 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 507/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:51 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:51.452168 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4cd5b11f-00f7-4fa4-994b-c26f5f7f0c92 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '.version_select at 0x7f03a2094d30>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:51.473557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4cd5b11f-00f7-4fa4-994b-c26f5f7f0c92 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605754875" status: 202 len: 0 microversion: 2.1 time: 0.025337 Aug 30 01:06:51.474132 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 513/1020] 10.222.0.17 () {58 vars in 1218 bytes} [Tue Aug 30 01:06:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605754875 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:06:53.370941 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:53.371690 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:53.378153 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:53.378632 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:53.379066 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:53.379788 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:53.380225 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:53.380642 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:53.396790 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: DELETE /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e HTTP/1.1 Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:06:53.398349 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.399810 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '0f6ea9bc-f519-45e0-9377-c10c41acea0e'} Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:53.400604 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.401830 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.404127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:53.404127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-e82061a1-011b-49b4-82f1-7adccd452e09 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 404 len: 111 microversion: 2.1 time: 0.032727 Aug 30 01:06:53.404127 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 508/1021] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:53 2022] DELETE /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:53.409207 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:53.409997 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0f6ea9bc-f519-45e0-9377-c10c41acea0e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:53.419470 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:53.419945 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:53.420376 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:53.421065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:53.421508 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:53.421921 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:53.426409 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:06:53.443197 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e HTTP/1.1 Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:06:53.445636 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.447804 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '0f6ea9bc-f519-45e0-9377-c10c41acea0e'} Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:53.449161 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. Aug 30 01:06:53.450922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:53.453713 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 0f6ea9bc-f519-45e0-9377-c10c41acea0e could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:53.454918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4e8e9b13-5ab7-4573-9f96-0068738aca26 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e" status: 404 len: 111 microversion: 2.1 time: 0.050064 Aug 30 01:06:53.459044 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 514/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:53 2022] GET /compute/v2.1/servers/0f6ea9bc-f519-45e0-9377-c10c41acea0e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:54.628369 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:54.628910 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:54.635116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.635832 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.636256 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.637181 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.637715 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.638134 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.652199 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: DELETE /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 HTTP/1.1 Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:06:54.653973 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.655608 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '250c1856-e84e-4823-975c-af13f060c627'} Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:54.656490 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.657753 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.660110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:54.661006 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-80f436fa-bda0-4fcf-98b6-e08d9415c6e0 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 404 len: 111 microversion: 2.1 time: 0.036610 Aug 30 01:06:54.661568 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 509/1023] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:54 2022] DELETE /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:54.669722 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:54.670464 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 250c1856-e84e-4823-975c-af13f060c627] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:54.677947 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.678551 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.679063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.679843 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.680353 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.680834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.696130 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 HTTP/1.1 Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:06:54.697790 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.699526 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '250c1856-e84e-4823-975c-af13f060c627'} Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:54.703892 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. Aug 30 01:06:54.705194 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.709934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 250c1856-e84e-4823-975c-af13f060c627 could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:54.709934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-10e6206c-ca44-475a-b77e-701176187cad tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627" status: 404 len: 111 microversion: 2.1 time: 0.033514 Aug 30 01:06:54.709934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 515/1024] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:54 2022] GET /compute/v2.1/servers/250c1856-e84e-4823-975c-af13f060c627 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 01:06:54.713859 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:54.715481 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:54.722251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.722804 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.723198 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.723896 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.724341 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.725165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.745637 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: DELETE /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e HTTP/1.1 Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:06:54.747435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.749116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '0d3180f7-92a4-4746-9b5a-d54b5a2c310e'} Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:54.750060 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.751538 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.752879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:54.752879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-34847e3e-2aa0-43e0-8caa-2c7be967776e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 404 len: 111 microversion: 2.1 time: 0.044036 Aug 30 01:06:54.752879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 510/1025] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:54 2022] DELETE /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:54.762006 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:54.763426 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: 0d3180f7-92a4-4746-9b5a-d54b5a2c310e] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:54.777578 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.778657 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.779312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.780051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:54.780694 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:54.781291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:54.798613 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e HTTP/1.1 Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:06:54.800400 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.802086 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': '0d3180f7-92a4-4746-9b5a-d54b5a2c310e'} Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:54.802929 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. Aug 30 01:06:54.804494 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:54.805891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance 0d3180f7-92a4-4746-9b5a-d54b5a2c310e could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:54.805891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-36b6cb34-af85-4218-a753-a7256e27862a tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e" status: 404 len: 111 microversion: 2.1 time: 0.048012 Aug 30 01:06:54.805891 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 516/1026] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:54 2022] GET /compute/v2.1/servers/0d3180f7-92a4-4746-9b5a-d54b5a2c310e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:55.947897 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:55.948931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:55.955836 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:55.956314 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:55.956744 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:55.957448 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:55.957870 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:55.958483 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:55.972874 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: DELETE /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab HTTP/1.1 Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:06:55.974564 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:55.976111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'fbe9a2cc-ace1-43b1-b535-23d338a9e2ab'} Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:55.977488 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:55.978772 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:06:55.982075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:55.982075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-56cf387a-7ee6-47b4-aab0-b43ff09748e9 tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 404 len: 111 microversion: 2.1 time: 0.031937 Aug 30 01:06:55.982075 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 511/1027] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:06:55 2022] DELETE /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:06:55.984936 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:06:55.985455 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] [instance: fbe9a2cc-ace1-43b1-b535-23d338a9e2ab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:06:55.997353 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:55.997962 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:55.998337 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:55.999065 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:06:55.999512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:06:55.999988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:06:56.014739 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.wsgi [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] HTTP exception thrown: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Request method failure captured: Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: request: GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab HTTP/1.1 Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept: application/json Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Accept-Encoding: identity Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Connection: close Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Length: 0 Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Content-Type: application/json Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Host: 10.222.0.17 Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: Openstack-System-Scope: None Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: User-Agent: python-urllib3/1.26.12 Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Auth-Token: gAAAAABjDWGvLqB_azfyziSHjKnCnKtrA-aAtd5KeQjWcuL46BzxECcf-i0ppGg-hXczTqfcC7irU_AvlA5GnOHA0BnpJfF5uMcEwcZ8sjwDZopYPkywt-_SmnLJAC4KGTU2nD_uO2n3_hy5aZvFOMTCw6x81mjENBM_Z2tRGd4ewjBJLzAzlek Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Id: None Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Domain-Name: None Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Identity-Status: Confirmed Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Is-Admin-Project: True Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Id: default Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Domain-Name: Default Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Project-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Role: reader,member Aug 30 01:06:56.016291 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Roles: reader,member Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fe19812dff73433b8b29d24ddbea3f56", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fe19812dff73433b8b29d24ddbea3f56"}]}] Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Id: fe19812dff73433b8b29d24ddbea3f56 Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-186994551 Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Id: default Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Domain-Name: Default Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Id: 9d7babb2d721414496d45840f9253852 Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: X-User-Name: tempest-AttachVolumeNegativeTest-186994551-project Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: method: > Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: exception: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:56.017811 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: action_args: {'id': 'fbe9a2cc-ace1-43b1-b535-23d338a9e2ab'} Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:06:56.019540 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. Aug 30 01:06:56.023633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR nova.api.openstack.wsgi Aug 30 01:06:56.025877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] Returning 404 to user: Instance fbe9a2cc-ace1-43b1-b535-23d338a9e2ab could not be found. {{(pid=144777) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:06:56.025877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-b40c58f0-ca38-4dad-89d7-229164dde18e tempest-AttachVolumeNegativeTest-186994551 tempest-AttachVolumeNegativeTest-186994551-project] 10.222.0.17 "GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab" status: 404 len: 111 microversion: 2.1 time: 0.036999 Aug 30 01:06:56.025877 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 517/1028] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:06:55 2022] GET /compute/v2.1/servers/fbe9a2cc-ace1-43b1-b535-23d338a9e2ab => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:07:50.496225 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-331179829", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452"}} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:50.503540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:50.504177 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:50.552542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.network.neutron [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] validate_networks() for None {{(pid=144776) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:07:50.832548 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Flavor limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:07:50.832963 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Image limits 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:07:50.833428 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Flavor pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:07:50.833829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Image pref 0:0:0 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:07:50.834229 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.virt.hardware [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:07:50.844276 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.844775 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.845192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.845903 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:50.846348 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:50.846771 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:50.864768 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Getting quotas for project 413877cae5214e78b40edcc8a896ba95. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:07:50.868962 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.quota [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Getting quotas for user 34aac11c7a0a4eeaa52c5690755310d7 and project 413877cae5214e78b40edcc8a896ba95. Resources: {'instances', 'cores', 'ram'} {{(pid=144776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:07:50.881252 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Going to run 1 instances... {{(pid=144776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:07:50.883586 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:07:50.934668 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR oslo.messaging._drivers.impl_rabbit [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [f50594b5-c616-4d23-a90c-38eedd5c97e4] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 01:07:51.944000 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO oslo.messaging._drivers.impl_rabbit [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [f50594b5-c616-4d23-a90c-38eedd5c97e4] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54310. Aug 30 01:07:51.948817 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-066ba043-bae2-4b0c-adbf-863b1f5ae5e1 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456736 Aug 30 01:07:51.949558 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 512/1029] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:07:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:07:51.961529 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-39426c9a-3ea0-4413-be5c-452c278af746 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:51.962175 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-39426c9a-3ea0-4413-be5c-452c278af746 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:51.964771 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:51.965918 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:07:52.026179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-39426c9a-3ea0-4413-be5c-452c278af746 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:52.033275 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-39426c9a-3ea0-4413-be5c-452c278af746 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1214 microversion: 2.1 time: 0.076136 Aug 30 01:07:52.033846 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 518/1030] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:51 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:53.054808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:53.055442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:53.063823 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:53.064311 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:53.064726 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:53.065435 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:53.065883 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:53.066297 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:53.130056 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:53.138102 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-705935bd-9cf4-480b-9e42-db3ddfd24021 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1266 microversion: 2.1 time: 0.087888 Aug 30 01:07:53.139039 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 513/1031] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:53 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:54.159552 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:54.160322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:54.169912 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:54.170047 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:54.170520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:54.171404 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:54.171848 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:54.172286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:54.421091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:54.429256 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-62ad9e9a-44f1-4168-95ba-0dabb967c26c tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1314 microversion: 2.1 time: 0.273655 Aug 30 01:07:54.429792 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 519/1032] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:54 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:54.862031 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-cd104f77-799d-4482-baa4-1ee16d3e4021 req-b5a8313a-f06c-4acd-bdbe-83bc02f5b503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1efd35f-91d4-4551-ad94-a6555b03c34c", "tag": "aea929fc-486e-44ad-8e48-1bf9f5fb77ce"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:07:54.871482 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-cd104f77-799d-4482-baa4-1ee16d3e4021 req-b5a8313a-f06c-4acd-bdbe-83bc02f5b503 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:54.871931 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-cd104f77-799d-4482-baa4-1ee16d3e4021 req-b5a8313a-f06c-4acd-bdbe-83bc02f5b503 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:54.872355 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-cd104f77-799d-4482-baa4-1ee16d3e4021 req-b5a8313a-f06c-4acd-bdbe-83bc02f5b503 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:54.884188 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-cd104f77-799d-4482-baa4-1ee16d3e4021 req-b5a8313a-f06c-4acd-bdbe-83bc02f5b503 service nova] Creating event network-changed:aea929fc-486e-44ad-8e48-1bf9f5fb77ce for instance a1efd35f-91d4-4551-ad94-a6555b03c34c on hv-cinder-81574 Aug 30 01:07:54.889646 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-cd104f77-799d-4482-baa4-1ee16d3e4021 req-b5a8313a-f06c-4acd-bdbe-83bc02f5b503 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156908 Aug 30 01:07:54.890441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 514/1033] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:07:55.452146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:55.452792 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:55.459922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.460399 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.460833 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.461512 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:55.461953 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:55.462368 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:55.593641 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:55.605958 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5675c623-8610-4a3c-8d2d-5d1a4097e1bf tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1314 microversion: 2.1 time: 0.157564 Aug 30 01:07:55.606784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 520/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:55 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:56.637580 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:56.638308 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:56.648614 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:56.649266 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:56.649815 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:56.650808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:56.651521 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:56.652145 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:56.867272 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:56.875442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a26fcb2b-31d6-4a78-ab95-48b79360257d tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1314 microversion: 2.1 time: 0.245238 Aug 30 01:07:56.876045 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 515/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:56 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:57.898130 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:57.898857 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:57.905739 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:57.906205 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:57.906753 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:57.907791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:57.908322 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:57.908827 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:58.047633 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:58.055439 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d3dd1966-ac28-4d60-97d3-8ee79b1b5b22 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1314 microversion: 2.1 time: 0.161241 Aug 30 01:07:58.056016 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 521/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:57 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:07:59.081057 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:07:59.082068 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:07:59.093459 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:59.094158 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:59.099462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:59.099462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:07:59.099462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:07:59.099462 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:07:59.239792 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:07:59.252541 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-d03f8aa8-1c1f-4a8e-b907-f817a6887557 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1314 microversion: 2.1 time: 0.178255 Aug 30 01:07:59.253294 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 516/1037] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:07:59 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:00.102723 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-cffbe9f1-ba13-4e3b-a98a-ac7669efa474 req-75027021-8d1f-4a21-ae62-58637a5e6ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1efd35f-91d4-4551-ad94-a6555b03c34c", "name": "network-vif-plugged", "status": "completed", "tag": "aea929fc-486e-44ad-8e48-1bf9f5fb77ce"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:00.112685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cffbe9f1-ba13-4e3b-a98a-ac7669efa474 req-75027021-8d1f-4a21-ae62-58637a5e6ef3 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:00.113173 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cffbe9f1-ba13-4e3b-a98a-ac7669efa474 req-75027021-8d1f-4a21-ae62-58637a5e6ef3 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:00.113593 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-cffbe9f1-ba13-4e3b-a98a-ac7669efa474 req-75027021-8d1f-4a21-ae62-58637a5e6ef3 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:00.124555 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-cffbe9f1-ba13-4e3b-a98a-ac7669efa474 req-75027021-8d1f-4a21-ae62-58637a5e6ef3 service nova] Creating event network-vif-plugged:aea929fc-486e-44ad-8e48-1bf9f5fb77ce for instance a1efd35f-91d4-4551-ad94-a6555b03c34c on hv-cinder-81574 Aug 30 01:08:00.129615 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-cffbe9f1-ba13-4e3b-a98a-ac7669efa474 req-75027021-8d1f-4a21-ae62-58637a5e6ef3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105231 Aug 30 01:08:00.130248 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 522/1038] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:00.274721 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:00.275371 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:00.282103 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:00.282583 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:00.283151 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:00.283906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:00.284352 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:00.284770 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:00.457287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:00.465100 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-2edd6030-0d51-4717-8d1a-7375002c95c3 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1314 microversion: 2.1 time: 0.195327 Aug 30 01:08:00.465690 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 517/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:00 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:01.487307 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:01.487980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:01.494260 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:01.494735 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:01.495167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:01.495881 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:01.496339 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:01.496760 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:01.649685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:01.658456 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-1b0adcc5-765c-4a18-9d9a-ca23864cee98 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1464 microversion: 2.1 time: 0.176068 Aug 30 01:08:01.659051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 523/1040] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:01 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1464 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:01.709108 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:01.709707 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:01.713230 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:01.714156 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=6 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:01.719274 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:01.719759 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:01.720717 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:01.721423 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:01.722031 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:01.722463 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:01.751411 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Going to try to terminate instance {{(pid=144776) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:08:01.841966 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-209eff6d-f97b-46e5-97af-973fdb51f414 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 204 len: 0 microversion: 2.1 time: 0.136754 Aug 30 01:08:01.842606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 518/1041] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:08:01 2022] DELETE /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:08:01.851146 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:01.851784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:01.857969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:01.858442 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:01.858898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:01.859621 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:01.860084 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:01.860500 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:01.999806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:02.007920 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-98582f3d-275d-4441-a9ec-aa0d15aed472 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1470 microversion: 2.1 time: 0.160684 Aug 30 01:08:02.008497 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 524/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:01 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:03.031540 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:03.032361 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:03.041323 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.041951 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.042572 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.043453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.044142 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.044722 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.219797 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34aac11c7a0a4eeaa52c5690755310d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413877cae5214e78b40edcc8a896ba95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:03.227982 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-883660b6-d5b5-403d-918f-0b3f62dbc121 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 200 len: 1470 microversion: 2.1 time: 0.202141 Aug 30 01:08:03.228563 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 519/1043] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:03 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:03.659988 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-aa4192c0-2f50-4e1a-b824-70b90945a174 req-00fa8e00-3010-48b6-a19b-5bd2a4083d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1efd35f-91d4-4551-ad94-a6555b03c34c", "name": "network-vif-deleted", "tag": "aea929fc-486e-44ad-8e48-1bf9f5fb77ce"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:03.665467 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:03.672844 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-aa4192c0-2f50-4e1a-b824-70b90945a174 req-00fa8e00-3010-48b6-a19b-5bd2a4083d1a service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:03.674033 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-aa4192c0-2f50-4e1a-b824-70b90945a174 req-00fa8e00-3010-48b6-a19b-5bd2a4083d1a service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:03.674474 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-aa4192c0-2f50-4e1a-b824-70b90945a174 req-00fa8e00-3010-48b6-a19b-5bd2a4083d1a service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:03.688903 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-aa4192c0-2f50-4e1a-b824-70b90945a174 req-00fa8e00-3010-48b6-a19b-5bd2a4083d1a service nova] Creating event network-vif-deleted:aea929fc-486e-44ad-8e48-1bf9f5fb77ce for instance a1efd35f-91d4-4551-ad94-a6555b03c34c on hv-cinder-81574 Aug 30 01:08:03.694147 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-aa4192c0-2f50-4e1a-b824-70b90945a174 req-00fa8e00-3010-48b6-a19b-5bd2a4083d1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039011 Aug 30 01:08:03.694761 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 525/1044] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:04.249656 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:04.250298 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] [instance: a1efd35f-91d4-4551-ad94-a6555b03c34c] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:04.257203 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:04.257682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:04.258107 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:04.258793 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:04.259278 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:04.259679 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:04.273135 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] HTTP exception thrown: Instance a1efd35f-91d4-4551-ad94-a6555b03c34c could not be found. Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Request method failure captured: Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c HTTP/1.1 Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWLk6zT6PgO7o2b75fUydyu3ePYqzQjdTWGrzt97kxWNbK7pu4rz9sIMnbHieUZjCYO1Jynm8YKQgmqdcLQr_5yE_gMikfpFInLwshqhUt33td0n4QMJ2zT9bT6yZdQkUX5vhhjWQP0KTDdfJYczrEZYyMbE3fq-nbO_wESyWcwJxYM Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: 413877cae5214e78b40edcc8a896ba95 Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesNegativeTest-1740541690 Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:08:04.274779 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/413877cae5214e78b40edcc8a896ba95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_413877cae5214e78b40edcc8a896ba95", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/413877cae5214e78b40edcc8a896ba95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/413877cae5214e78b40edcc8a896ba95"}]}] Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesNegativeTest-1740541690 Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: 413877cae5214e78b40edcc8a896ba95 Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesNegativeTest-1740541690 Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesNegativeTest-1740541690-project Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: 34aac11c7a0a4eeaa52c5690755310d7 Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesNegativeTest-1740541690-project Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance a1efd35f-91d4-4551-ad94-a6555b03c34c could not be found. Aug 30 01:08:04.276456 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': 'a1efd35f-91d4-4551-ad94-a6555b03c34c'} Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1efd35f-91d4-4551-ad94-a6555b03c34c could not be found. Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:08:04.277503 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1efd35f-91d4-4551-ad94-a6555b03c34c could not be found. Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1efd35f-91d4-4551-ad94-a6555b03c34c could not be found. Aug 30 01:08:04.279125 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:08:04.281123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] Returning 404 to user: Instance a1efd35f-91d4-4551-ad94-a6555b03c34c could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:08:04.281123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-90ef9ca0-f231-41af-ad15-c5d1bd55cb01 tempest-VolumesNegativeTest-1740541690 tempest-VolumesNegativeTest-1740541690-project] 10.222.0.17 "GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c" status: 404 len: 111 microversion: 2.1 time: 0.030596 Aug 30 01:08:04.281123 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 520/1045] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:04 2022] GET /compute/v2.1/servers/a1efd35f-91d4-4551-ad94-a6555b03c34c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:08:12.431443 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1614020465", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "networks": [{"uuid": "3ea40e1a-8cb9-473e-a6d0-66806cf56b04"}]}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:12.490143 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] validate_networks() for [('3ea40e1a-8cb9-473e-a6d0-66806cf56b04', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:08:12.980236 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:08:12.980648 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:08:12.981111 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:08:12.981506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:08:12.981902 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:08:12.992566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:12.993039 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:12.993464 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:12.994176 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:12.994619 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:12.995093 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:13.012898 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Getting quotas for project a16714c5d5764197a61b90b9ce3661ba. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:08:13.017434 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Getting quotas for user bd00ed08709940969d44e416358073eb and project a16714c5d5764197a61b90b9ce3661ba. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:08:13.029340 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:08:13.032539 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:08:13.085374 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: ERROR oslo.messaging._drivers.impl_rabbit [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [f8fba6ba-0c94-42ca-a817-f5ed3f6677bf] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 01:08:14.100311 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO oslo.messaging._drivers.impl_rabbit [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [f8fba6ba-0c94-42ca-a817-f5ed3f6677bf] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54670. Aug 30 01:08:14.104391 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-aeaf201d-9df5-4743-92e6-2e9e1fb06da1 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678024 Aug 30 01:08:14.105389 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 526/1046] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:08:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:08:14.116704 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bdb584d3-c3f5-4c92-9a46-a22308dba17a tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:14.117302 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bdb584d3-c3f5-4c92-9a46-a22308dba17a tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:14.185637 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bdb584d3-c3f5-4c92-9a46-a22308dba17a tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:14.194432 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bdb584d3-c3f5-4c92-9a46-a22308dba17a tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1219 microversion: 2.1 time: 0.081518 Aug 30 01:08:14.194875 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 521/1047] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:14 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:15.216617 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:15.217878 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:15.225546 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:15.226317 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:15.226750 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:15.227707 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:15.228699 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:15.229350 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:15.305583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:15.315914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c4416001-02b4-466a-83c0-6b7b45908588 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1289 microversion: 2.1 time: 0.103718 Aug 30 01:08:15.316806 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 527/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:15 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:16.337526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:16.338165 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:16.344177 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:16.347428 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:16.347899 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:16.348379 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:16.349155 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:16.349606 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:16.350033 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:16.573087 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:16.583045 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-2b8d2bef-5cbe-4b1c-9249-2aab7a8955e2 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1319 microversion: 2.1 time: 0.249052 Aug 30 01:08:16.593984 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 522/1049] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:16 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:16.628503 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-428076ef-f980-4284-8ab1-2a79e3ff0c69 req-c1438807-d4fc-4c0f-9477-ef09f7f33bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e237474-db1c-4a74-8741-39564f5d5aab", "tag": "a06504bf-72b1-4643-84ba-62fd11342cd6"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:16.639190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-428076ef-f980-4284-8ab1-2a79e3ff0c69 req-c1438807-d4fc-4c0f-9477-ef09f7f33bd4 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:16.639579 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-428076ef-f980-4284-8ab1-2a79e3ff0c69 req-c1438807-d4fc-4c0f-9477-ef09f7f33bd4 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:16.640007 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-428076ef-f980-4284-8ab1-2a79e3ff0c69 req-c1438807-d4fc-4c0f-9477-ef09f7f33bd4 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:16.652672 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-428076ef-f980-4284-8ab1-2a79e3ff0c69 req-c1438807-d4fc-4c0f-9477-ef09f7f33bd4 service nova] Creating event network-changed:a06504bf-72b1-4643-84ba-62fd11342cd6 for instance 1e237474-db1c-4a74-8741-39564f5d5aab on hv-cinder-81574 Aug 30 01:08:16.658312 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-428076ef-f980-4284-8ab1-2a79e3ff0c69 req-c1438807-d4fc-4c0f-9477-ef09f7f33bd4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033858 Aug 30 01:08:16.659138 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 528/1050] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:17.607281 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:17.608198 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:17.616925 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:17.617593 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:17.618110 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:17.618837 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:17.619324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:17.619733 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:17.801895 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:17.810195 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-7519bc56-0fa4-48de-89cf-363d24f805a5 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1319 microversion: 2.1 time: 0.208081 Aug 30 01:08:17.810766 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 523/1051] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:17 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:18.838202 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:18.839124 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:18.849054 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:18.849532 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:18.849960 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:18.850659 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:18.851139 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:18.851558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:18.997026 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:19.010556 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5fa00ee0-0ffd-4a28-b30e-bb99a71ea028 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1319 microversion: 2.1 time: 0.180073 Aug 30 01:08:19.011465 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 529/1052] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:18 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:20.035229 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:20.035803 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:20.042244 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:20.042726 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:20.043192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:20.043889 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:20.044344 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:20.044760 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:20.179906 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:20.188255 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ba7ce5e0-2341-48f6-a8d0-2797d995536d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1319 microversion: 2.1 time: 0.157839 Aug 30 01:08:20.189033 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 524/1053] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:20 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:21.210179 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:21.210780 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:21.217656 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:21.218136 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:21.218566 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:21.219323 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:21.219807 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:21.220299 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:21.356638 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:21.364702 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-9def1d3d-1a03-4761-907f-4696bc4c9766 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1319 microversion: 2.1 time: 0.158513 Aug 30 01:08:21.365244 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 530/1054] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:21 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:08:22.118453 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-96ffb390-cd04-44e3-a137-a762336d12c8 req-0e5a0991-e5d1-4e32-b655-c68ff4aa6af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e237474-db1c-4a74-8741-39564f5d5aab", "name": "network-vif-plugged", "status": "completed", "tag": "a06504bf-72b1-4643-84ba-62fd11342cd6"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:22.124575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:22.130879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-96ffb390-cd04-44e3-a137-a762336d12c8 req-0e5a0991-e5d1-4e32-b655-c68ff4aa6af5 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:22.131387 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-96ffb390-cd04-44e3-a137-a762336d12c8 req-0e5a0991-e5d1-4e32-b655-c68ff4aa6af5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:22.131812 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-96ffb390-cd04-44e3-a137-a762336d12c8 req-0e5a0991-e5d1-4e32-b655-c68ff4aa6af5 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:22.146200 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-96ffb390-cd04-44e3-a137-a762336d12c8 req-0e5a0991-e5d1-4e32-b655-c68ff4aa6af5 service nova] Creating event network-vif-plugged:a06504bf-72b1-4643-84ba-62fd11342cd6 for instance 1e237474-db1c-4a74-8741-39564f5d5aab on hv-cinder-81574 Aug 30 01:08:22.151364 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-96ffb390-cd04-44e3-a137-a762336d12c8 req-0e5a0991-e5d1-4e32-b655-c68ff4aa6af5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037063 Aug 30 01:08:22.151952 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 525/1055] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:22.389519 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:22.390638 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:22.398956 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:22.402867 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:22.403791 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:22.404377 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:22.405123 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:22.405627 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:22.406094 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:22.410278 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=57 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:22.552261 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:22.564520 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-e4e857fd-1b1f-4c45-babe-1d7db45fe0a6 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1319 microversion: 2.1 time: 0.181760 Aug 30 01:08:22.565117 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 531/1056] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:22 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:23.587971 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:23.588798 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:23.597220 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:23.598159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:23.598675 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:23.599814 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:23.600378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:23.601044 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:23.743334 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:08:23.753790 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-ff1e36f1-fa86-4d91-b129-3a0c706cdf29 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1508 microversion: 2.1 time: 0.171629 Aug 30 01:08:23.754567 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 526/1057] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:08:23 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:08:39.126089 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "976b35ca-65db-43e0-b489-bae13360b44f", "device": "/dev/sdb"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:08:39.130853 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:39.133980 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:39.135236 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:39.136433 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:39.137099 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=5 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:39.144103 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:39.144919 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:39.145686 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:39.146938 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:39.147789 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:39.148327 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:39.441145 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-71851cdc-285f-493c-9430-a7a3c90276b7 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "POST /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319227 Aug 30 01:08:39.441798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 532/1058] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:08:39 2022] POST /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:08:59.509847 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:08:59.510457 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:08:59.512480 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:59.513251 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=3 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:59.513811 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=26 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:08:59.520933 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:59.521422 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:59.521844 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:59.522526 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:08:59.522972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:08:59.523412 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:08:59.613288 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lazy-loading 'services' on Instance uuid 1e237474-db1c-4a74-8741-39564f5d5aab {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:08:59.692632 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-77a77975-2fea-4c53-87c9-ef2b7c7f8840 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab/os-volume_attachments/976b35ca-65db-43e0-b489-bae13360b44f" status: 202 len: 0 microversion: 2.1 time: 0.185700 Aug 30 01:08:59.693560 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 527/1059] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:08:59 2022] DELETE /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab/os-volume_attachments/976b35ca-65db-43e0-b489-bae13360b44f => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:09:00.829772 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:00.830586 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:00.835051 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:00.835630 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:00.843542 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:00.844153 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:00.844585 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:00.845372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:00.845833 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:00.846398 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:00.873901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:09:00.969750 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f4de64aa-e108-4885-a98c-1bac4577934c tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 204 len: 0 microversion: 2.1 time: 0.140953 Aug 30 01:09:00.970533 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 533/1060] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:09:00 2022] DELETE /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:09:00.981739 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:00.982683 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:00.992444 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:00.993006 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:00.993442 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:00.994142 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:00.994593 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:00.995042 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:01.139484 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:01.147542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-b0bafdc0-5ae3-4448-b509-2b1005340ae0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1514 microversion: 2.1 time: 0.172503 Aug 30 01:09:01.148114 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 528/1061] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:00 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 01:09:02.170369 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:02.171167 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:02.179329 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:02.179910 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:02.180499 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:02.181571 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:02.182240 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:02.182914 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:02.340102 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:02.348957 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-d5049a53-816b-45cb-b62b-d37a0d3c4376 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1514 microversion: 2.1 time: 0.183433 Aug 30 01:09:02.349834 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 534/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:02 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:03.084441 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-c8923654-2e5e-45c1-b3fd-bdc3477a3ebf req-407fc899-447c-45b4-a8ae-912dffeea0bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e237474-db1c-4a74-8741-39564f5d5aab", "name": "network-vif-deleted", "tag": "a06504bf-72b1-4643-84ba-62fd11342cd6"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:03.099083 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c8923654-2e5e-45c1-b3fd-bdc3477a3ebf req-407fc899-447c-45b4-a8ae-912dffeea0bb service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:03.099083 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c8923654-2e5e-45c1-b3fd-bdc3477a3ebf req-407fc899-447c-45b4-a8ae-912dffeea0bb service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:03.099528 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-c8923654-2e5e-45c1-b3fd-bdc3477a3ebf req-407fc899-447c-45b4-a8ae-912dffeea0bb service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:03.115332 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-c8923654-2e5e-45c1-b3fd-bdc3477a3ebf req-407fc899-447c-45b4-a8ae-912dffeea0bb service nova] Creating event network-vif-deleted:a06504bf-72b1-4643-84ba-62fd11342cd6 for instance 1e237474-db1c-4a74-8741-39564f5d5aab on hv-cinder-81574 Aug 30 01:09:03.120493 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-c8923654-2e5e-45c1-b3fd-bdc3477a3ebf req-407fc899-447c-45b4-a8ae-912dffeea0bb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040271 Aug 30 01:09:03.121097 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 529/1063] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:03.373901 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:03.374539 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:03.381454 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:03.381924 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:03.382453 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:03.383185 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:03.383631 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:03.384096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:03.419049 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:03.419530 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:03.419961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:03.420403 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lazy-loading 'fault' on Instance uuid 1e237474-db1c-4a74-8741-39564f5d5aab {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:09:03.466618 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:03.476096 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-8e525902-536b-4c73-bfcb-dc4e86fdfe15 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 200 len: 1309 microversion: 2.1 time: 0.109798 Aug 30 01:09:03.476886 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 535/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:03 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:04.499111 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:04.499797 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 1e237474-db1c-4a74-8741-39564f5d5aab] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:04.506523 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:04.507285 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:04.507782 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:04.508470 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:04.508923 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:04.509330 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:04.523308 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] HTTP exception thrown: Instance 1e237474-db1c-4a74-8741-39564f5d5aab could not be found. Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Request method failure captured: Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab HTTP/1.1 Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWL6VvVO_skmpUROHa59BX7EhXAlAae9wRLuEbaZeNNFm2gY-FoKJfTbBDbpptvP-KrjOvt9LEsWjrq_C9uJdTqCuq7W2mYHoeyhYrz9BpBjTh2v_AUYjF8qpNn_SrUnCKcb8zwb0IVmX8BQ28K6viO5-CN7a-ESnisOlOQQff-gDVE Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: a16714c5d5764197a61b90b9ce3661ba Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesSnapshotTestJSON-301440955 Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:09:04.524919 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a16714c5d5764197a61b90b9ce3661ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a16714c5d5764197a61b90b9ce3661ba", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a16714c5d5764197a61b90b9ce3661ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a16714c5d5764197a61b90b9ce3661ba"}]}] Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesSnapshotTestJSON-301440955 Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: a16714c5d5764197a61b90b9ce3661ba Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-301440955 Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesSnapshotTestJSON-301440955-project Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: bd00ed08709940969d44e416358073eb Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesSnapshotTestJSON-301440955-project Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 1e237474-db1c-4a74-8741-39564f5d5aab could not be found. Aug 30 01:09:04.526839 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '1e237474-db1c-4a74-8741-39564f5d5aab'} Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e237474-db1c-4a74-8741-39564f5d5aab could not be found. Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:09:04.527820 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e237474-db1c-4a74-8741-39564f5d5aab could not be found. Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e237474-db1c-4a74-8741-39564f5d5aab could not be found. Aug 30 01:09:04.529287 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:04.530677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Returning 404 to user: Instance 1e237474-db1c-4a74-8741-39564f5d5aab could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:09:04.530677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-00504320-69f1-4561-848a-be2fe9cc9905 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab" status: 404 len: 111 microversion: 2.1 time: 0.032061 Aug 30 01:09:04.530677 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 530/1065] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:04 2022] GET /compute/v2.1/servers/1e237474-db1c-4a74-8741-39564f5d5aab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 01:09:12.398715 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2014399093", "imageRef": "0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2", "flavorRef": "452", "networks": [{"uuid": "3ea40e1a-8cb9-473e-a6d0-66806cf56b04"}]}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:12.466780 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.network.neutron [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] validate_networks() for [('3ea40e1a-8cb9-473e-a6d0-66806cf56b04', None, None, None, None, None)] {{(pid=144777) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 01:09:12.848509 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Flavor limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 01:09:12.848934 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Image limits 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 01:09:12.849411 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Flavor pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 01:09:12.849813 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Image pref 0:0:0 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 01:09:12.850222 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.virt.hardware [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=144777) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 01:09:12.860057 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:12.860538 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:12.860974 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:12.861699 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:12.862153 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:12.862575 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:12.880583 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Getting quotas for project a16714c5d5764197a61b90b9ce3661ba. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 01:09:12.885360 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.quota [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Getting quotas for user bd00ed08709940969d44e416358073eb and project a16714c5d5764197a61b90b9ce3661ba. Resources: {'instances', 'cores', 'ram'} {{(pid=144777) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 01:09:12.898305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Going to run 1 instances... {{(pid=144777) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 01:09:12.901231 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0d5bbad9-ebf5-4d5b-be3c-e8b2388b81c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=144777) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 01:09:12.950375 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-38a22130-10b2-4c30-ac7a-8a7aa4791622 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561563 Aug 30 01:09:12.951035 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 536/1066] 10.222.0.17 () {60 vars in 1147 bytes} [Tue Aug 30 01:09:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 01:09:12.963389 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-bae946af-838d-4005-ad48-c29ea3dbc795 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:12.963972 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-bae946af-838d-4005-ad48-c29ea3dbc795 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:13.019159 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-bae946af-838d-4005-ad48-c29ea3dbc795 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:13.026418 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-bae946af-838d-4005-ad48-c29ea3dbc795 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1219 microversion: 2.1 time: 0.068030 Aug 30 01:09:13.027078 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 531/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:12 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:14.049078 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:14.049666 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:14.059552 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:14.060036 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:14.060458 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:14.061158 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:14.061598 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:14.062022 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:14.180776 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:14.189176 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-c9662398-38d1-4675-a0d4-7fcdd5592f96 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1289 microversion: 2.1 time: 0.145614 Aug 30 01:09:14.190063 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 537/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:14 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1289 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:15.210147 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:15.211113 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:15.213786 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:15.220954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:15.221575 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:15.222020 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:15.222757 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:15.223315 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:15.223747 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:15.417648 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:15.425829 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-5abbd652-dceb-49b0-b6c3-b405c793c0a9 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1319 microversion: 2.1 time: 0.219650 Aug 30 01:09:15.426401 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 532/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:15 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:15.660346 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [req-a08d7621-6509-4acf-94a1-b0060fea9544 req-94243d43-8b3b-407f-9923-474e443d41d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185bdda5-0e4f-4dff-888c-d5420b2e1a87", "tag": "9d28192d-62c6-4f91-948d-c3e6ff34cae7"}]} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:15.671156 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-a08d7621-6509-4acf-94a1-b0060fea9544 req-94243d43-8b3b-407f-9923-474e443d41d2 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:15.671731 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-a08d7621-6509-4acf-94a1-b0060fea9544 req-94243d43-8b3b-407f-9923-474e443d41d2 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:15.672256 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [req-a08d7621-6509-4acf-94a1-b0060fea9544 req-94243d43-8b3b-407f-9923-474e443d41d2 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:15.683909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.compute.server_external_events [req-a08d7621-6509-4acf-94a1-b0060fea9544 req-94243d43-8b3b-407f-9923-474e443d41d2 service nova] Creating event network-changed:9d28192d-62c6-4f91-948d-c3e6ff34cae7 for instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 on hv-cinder-81574 Aug 30 01:09:15.689247 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [req-a08d7621-6509-4acf-94a1-b0060fea9544 req-94243d43-8b3b-407f-9923-474e443d41d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032826 Aug 30 01:09:15.690371 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 538/1070] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:16.448838 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:16.449439 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:16.456324 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:16.456808 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:16.457237 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:16.457924 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:16.458378 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:16.458797 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:16.599278 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:16.607572 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-8393214c-35ad-4ed2-8bad-85267953487d tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1319 microversion: 2.1 time: 0.163223 Aug 30 01:09:16.608169 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 533/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:16 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:17.630122 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:17.630815 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:17.637979 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:17.638459 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:17.638888 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:17.639625 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:17.640091 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:17.640506 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:17.796216 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:17.808286 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-26ea548e-7347-4268-af4f-74b83d1d2d3b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1319 microversion: 2.1 time: 0.182866 Aug 30 01:09:17.808932 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 539/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:17 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:18.830455 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:18.831119 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:18.838856 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:18.840067 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:18.840067 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:18.840489 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:18.840941 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:18.841347 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:18.989019 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:18.997116 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-9d8c414f-660c-4ea9-abd2-56bbac759ad3 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1319 microversion: 2.1 time: 0.170969 Aug 30 01:09:18.997689 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 534/1073] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:18 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:20.018342 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:20.019029 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:20.026432 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:20.026909 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:20.027372 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:20.028115 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:20.028537 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:20.028954 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:20.174745 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:20.191850 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-24d0aa25-4fa9-4f66-8717-4c990a0cb3e0 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1319 microversion: 2.1 time: 0.177472 Aug 30 01:09:20.192481 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 540/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:20 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:20.442218 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-8eb77dff-8fda-45f6-a267-98f52df9fc43 req-f550ecc2-ec04-4658-b785-9f2748415bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185bdda5-0e4f-4dff-888c-d5420b2e1a87", "name": "network-vif-plugged", "status": "completed", "tag": "9d28192d-62c6-4f91-948d-c3e6ff34cae7"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:20.453800 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-8eb77dff-8fda-45f6-a267-98f52df9fc43 req-f550ecc2-ec04-4658-b785-9f2748415bd0 service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:20.455126 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-8eb77dff-8fda-45f6-a267-98f52df9fc43 req-f550ecc2-ec04-4658-b785-9f2748415bd0 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:20.455554 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-8eb77dff-8fda-45f6-a267-98f52df9fc43 req-f550ecc2-ec04-4658-b785-9f2748415bd0 service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:20.467795 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-8eb77dff-8fda-45f6-a267-98f52df9fc43 req-f550ecc2-ec04-4658-b785-9f2748415bd0 service nova] Creating event network-vif-plugged:9d28192d-62c6-4f91-948d-c3e6ff34cae7 for instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 on hv-cinder-81574 Aug 30 01:09:20.473253 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-8eb77dff-8fda-45f6-a267-98f52df9fc43 req-f550ecc2-ec04-4658-b785-9f2748415bd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034662 Aug 30 01:09:20.473861 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 535/1075] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:21.213416 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:21.214060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:21.220912 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:21.221417 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:21.221879 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:21.222558 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:21.223037 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:21.223444 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:21.356160 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:21.363956 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-5d055df2-7b26-4a0d-987a-42c6a5afb073 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1319 microversion: 2.1 time: 0.154688 Aug 30 01:09:21.364517 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 541/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:21 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:22.386479 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:22.387192 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:22.394323 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:22.395522 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:22.395967 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:22.396682 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:22.397133 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:22.397542 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:22.552080 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:22.560226 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-00089c16-f10c-4a10-8507-f75abcf10377 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1509 microversion: 2.1 time: 0.178216 Aug 30 01:09:22.560804 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 536/1077] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:22 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:22.581653 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb11332d-0003-4099-92d9-2586e43289f7", "device": "/dev/sdb"}} {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:22.584087 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:22.590784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:22.591315 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:22.591745 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:22.592429 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:22.592873 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:22.593293 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:22.869631 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:22.876685 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-494513cf-eb95-4da6-a536-641083207b99 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "POST /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299079 Aug 30 01:09:22.877305 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 542/1078] 10.222.0.17 () {60 vars in 1323 bytes} [Tue Aug 30 01:09:22 2022] POST /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:39.253040 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:39.253643 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:39.255592 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell0:SELECT=2 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:39.256290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_api:SELECT=22 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:39.256884 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG dbcounter [-] [144776] Writing DB stats nova_cell1:SELECT=26 {{(pid=144776) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:39.263039 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:39.263716 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:39.264157 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:39.264852 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:39.265301 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:39.265713 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:39.357504 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.objects.instance [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lazy-loading 'services' on Instance uuid 185bdda5-0e4f-4dff-888c-d5420b2e1a87 {{(pid=144776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:09:39.445228 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-a5e08e48-5fd4-4fe3-b59a-75d6d8a35c02 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "DELETE /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87/os-volume_attachments/bb11332d-0003-4099-92d9-2586e43289f7" status: 202 len: 0 microversion: 2.1 time: 0.196362 Aug 30 01:09:39.445827 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 537/1079] 10.222.0.17 () {58 vars in 1416 bytes} [Tue Aug 30 01:09:39 2022] DELETE /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87/os-volume_attachments/bb11332d-0003-4099-92d9-2586e43289f7 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 01:09:40.572807 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell0:SELECT=6 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:40.574176 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:40.574798 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG dbcounter [-] [144777] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=144777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 01:09:40.579377 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:40.579961 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:40.589009 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:40.589483 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:40.589911 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:40.590610 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:40.591135 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:40.591559 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:40.622969 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Going to try to terminate instance {{(pid=144777) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 01:09:40.712955 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4efc3ac8-415f-41db-9823-ad07fc3ba600 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "DELETE /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 204 len: 0 microversion: 2.1 time: 0.140683 Aug 30 01:09:40.713536 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 543/1080] 10.222.0.17 () {58 vars in 1239 bytes} [Tue Aug 30 01:09:40 2022] DELETE /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 01:09:40.723112 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:40.723807 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:40.730465 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:40.730949 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:40.731420 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:40.732635 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:40.733150 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:40.733595 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:40.876167 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.policy [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144776) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:40.884221 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-0e9ed1fa-715c-478c-926b-bd839ee3c27b tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1515 microversion: 2.1 time: 0.165810 Aug 30 01:09:40.884777 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 538/1081] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:40 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:41.908557 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:41.909344 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:41.917190 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:41.917784 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:41.918292 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:41.919152 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:41.919714 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:41.920134 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:42.060189 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:42.079922 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-4e5b8e6e-f038-4789-b33e-35b9d8ffc922 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1515 microversion: 2.1 time: 0.169081 Aug 30 01:09:42.080894 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 544/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:41 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:42.793624 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [req-23075680-7443-4057-85b5-e7a3b2bb318c req-9965848a-43b5-4c45-ad54-ab0633d774fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185bdda5-0e4f-4dff-888c-d5420b2e1a87", "name": "network-vif-deleted", "tag": "9d28192d-62c6-4f91-948d-c3e6ff34cae7"}]} {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 01:09:42.804340 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-23075680-7443-4057-85b5-e7a3b2bb318c req-9965848a-43b5-4c45-ad54-ab0633d774fe service nova] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:42.804823 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-23075680-7443-4057-85b5-e7a3b2bb318c req-9965848a-43b5-4c45-ad54-ab0633d774fe service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:42.805290 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [req-23075680-7443-4057-85b5-e7a3b2bb318c req-9965848a-43b5-4c45-ad54-ab0633d774fe service nova] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:42.817607 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.compute.server_external_events [req-23075680-7443-4057-85b5-e7a3b2bb318c req-9965848a-43b5-4c45-ad54-ab0633d774fe service nova] Creating event network-vif-deleted:9d28192d-62c6-4f91-948d-c3e6ff34cae7 for instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 on hv-cinder-81574 Aug 30 01:09:42.822850 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [req-23075680-7443-4057-85b5-e7a3b2bb318c req-9965848a-43b5-4c45-ad54-ab0633d774fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Aug 30 01:09:42.823514 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 539/1083] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Aug 30 01:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 01:09:43.108477 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.api.openstack.wsgi [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144777) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:43.109136 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.compute.api [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144777) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:43.116591 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:43.117060 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:43.117496 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:43.118258 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:43.118705 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:43.119159 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:43.154939 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:43.155449 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:43.155883 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG oslo_concurrency.lockutils [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=144777) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:43.156333 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.objects.instance [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lazy-loading 'fault' on Instance uuid 185bdda5-0e4f-4dff-888c-d5420b2e1a87 {{(pid=144777) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 01:09:43.204335 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: DEBUG nova.policy [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd00ed08709940969d44e416358073eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a16714c5d5764197a61b90b9ce3661ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144777) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 01:09:43.212836 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: INFO nova.api.openstack.requestlog [None req-f6c61cc4-470d-452a-b4fd-06a0ba847d34 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 200 len: 1309 microversion: 2.1 time: 0.109608 Aug 30 01:09:43.213362 dv-cinder-815746-8-iscsi devstack@n-api.service[144777]: [pid: 144777|app: 0|req: 545/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:43 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 01:09:44.236605 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Calling method '>' {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 01:09:44.237320 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.compute.api [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] [instance: 185bdda5-0e4f-4dff-888c-d5420b2e1a87] Fetching instance by UUID {{(pid=144776) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 01:09:44.244846 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:44.245285 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:44.245777 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:44.246501 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Acquiring lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 01:09:44.246954 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 01:09:44.247493 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG oslo_concurrency.lockutils [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Lock "7a8879ab-9ba0-40de-b078-fe33ec09ccfb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=144776) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 01:09:44.262879 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.wsgi [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] HTTP exception thrown: Instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 could not be found. Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Request method failure captured: Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: request: GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 HTTP/1.1 Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept: application/json Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Accept-Encoding: identity Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Connection: close Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Length: 0 Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Content-Type: application/json Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Host: 10.222.0.17 Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: Openstack-System-Scope: None Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: User-Agent: python-urllib3/1.26.12 Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Auth-Token: gAAAAABjDWL6VvVO_skmpUROHa59BX7EhXAlAae9wRLuEbaZeNNFm2gY-FoKJfTbBDbpptvP-KrjOvt9LEsWjrq_C9uJdTqCuq7W2mYHoeyhYrz9BpBjTh2v_AUYjF8qpNn_SrUnCKcb8zwb0IVmX8BQ28K6viO5-CN7a-ESnisOlOQQff-gDVE Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Id: None Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Domain-Name: None Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Identity-Status: Confirmed Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Is-Admin-Project: True Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Id: default Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Domain-Name: Default Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Id: a16714c5d5764197a61b90b9ce3661ba Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Project-Name: tempest-VolumesSnapshotTestJSON-301440955 Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Role: reader,member Aug 30 01:09:44.264776 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Roles: reader,member Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a16714c5d5764197a61b90b9ce3661ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a16714c5d5764197a61b90b9ce3661ba", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a16714c5d5764197a61b90b9ce3661ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a16714c5d5764197a61b90b9ce3661ba"}]}] Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant: tempest-VolumesSnapshotTestJSON-301440955 Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Id: a16714c5d5764197a61b90b9ce3661ba Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-301440955 Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User: tempest-VolumesSnapshotTestJSON-301440955-project Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Id: default Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Domain-Name: Default Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Id: bd00ed08709940969d44e416358073eb Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: X-User-Name: tempest-VolumesSnapshotTestJSON-301440955-project Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: method: > Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: exception: Instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 could not be found. Aug 30 01:09:44.266449 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: action_args: {'id': '185bdda5-0e4f-4dff-888c-d5420b2e1a87'} Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: {{(pid=144776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 could not be found. Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 01:09:44.267382 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 could not be found. Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 could not be found. Aug 30 01:09:44.269038 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: ERROR nova.api.openstack.wsgi Aug 30 01:09:44.271539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: DEBUG nova.api.openstack.wsgi [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] Returning 404 to user: Instance 185bdda5-0e4f-4dff-888c-d5420b2e1a87 could not be found. {{(pid=144776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 01:09:44.271539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: INFO nova.api.openstack.requestlog [None req-2ff4ac05-7e7c-45ea-ba23-3bb91035fd54 tempest-VolumesSnapshotTestJSON-301440955 tempest-VolumesSnapshotTestJSON-301440955-project] 10.222.0.17 "GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87" status: 404 len: 111 microversion: 2.1 time: 0.034535 Aug 30 01:09:44.271539 dv-cinder-815746-8-iscsi devstack@n-api.service[144776]: [pid: 144776|app: 0|req: 540/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Tue Aug 30 01:09:44 2022] GET /compute/v2.1/servers/185bdda5-0e4f-4dff-888c-d5420b2e1a87 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)